EE 531 - Probability and Stochastic Processes

Haftalık özet

• 

  Genel

  EE 531

  Probability and Stochastic Processes

  Instructor: Prof. Dr. Elif Uysal

  
  

  Course Content

  Review of probability theory. Sequence of random variables, stochastic convergence. Discrete stochastic processes: The Poisson process, Counting processes, Renewal processes. Finite State Markov Chains, Countable state Markov Chains. Gaussian processes, Brownian motion.

  
  
• 

  Course Materials

  • Lecture 1: MEASURABLE SPACES Dosya
  • Lecture 2: PROBABILITY SPACES Dosya
  • Lecture 3: CONTINUITY OF PROBABILITY, BAYES' S RULE, INDEPENDENCE Dosya
  • Lecture 4: BOREL CANTELLI LEMMAS Dosya
  • Lecture 5: PROOF OF THE BOREL CANTELLI LEMMAS Dosya
  • Lecture 6: RANDOM VARIABLES Dosya
  • Lecture 7: CUMULATIVE DISTRIBUTION FUNCTION (CDF) Dosya
  • Lecture 8: DISCRETE RANDOM VARIABLES Dosya
  • Lecture 9: CONTINUOUS RANDOM VARIABLES Dosya
  • Lecture 10: INTRODUCTION TO STOCHASTIC PROCESSES Dosya
  • Lecture 11: DISCRETE STOCHASTIC PROCESSES Dosya
  • Lecture 12: EXPECTATION Dosya
  • Lecture 13: VARIANCE Dosya
  • Lecture 14: COVARIANCE Dosya
  • Lecture 15: CONDITIONAL EXPECTATION Dosya
  • Lecture 16: ITERATED EXPECTATION Dosya
  • Lecture 17: MARKOV & CHEBYCHEV INEQUALITIES Dosya
  • Lecture 18: CONVERGENCE IN PROBABILITY Dosya
  • Lecture 19: CONVERGENCE IN DISTRIBUTION Dosya
  • Lecture 20: MEAN SQUARE SENSE AND ALMOST SURE CONVERGENCE Dosya
  • Lecture 21: EXAMPLE: ALMOST SURE CONVERGENCE Dosya
  • Lecture 22: EXAMPLE: IN PROBABILITY vs MSE CONVERGENCE Dosya
  • Lecture 23: EXAMPLE: MSE CONVERGENCE DOES NOT IMPLY ALMOST SURE CONVERGENCE Dosya
  • Lecture 24: COUNTING PROCESSES Dosya
  • Lecture 25: THE POISSON PROCESS (DEFINITION 1) Dosya
  • Lecture 26: THE POISSON PROCESS (DEFINITION 2) Dosya
  • Lecture 27: THE POISSON PROCESS (DEFINITION 3) Dosya
  • Lecture 28: MERGING AND SPLITTING POISSON PROCESSES Dosya
  • Lecture 29: POISSON PROCESS EXAMPLE Dosya
  • Lecture 30- MARKOV CHAINS Dosya
  • Lecture 31: CONVERGENCE IN MARKOV CHAINS Dosya
  • Lecture 32: MARKOV CHAINS: CLASSIFICATION OF STATES PART 1 Dosya
  • Lecture 33: MARKOV CHAINS: CLASSIFICATION OF STATES PART 2 Dosya
  • Lecture 34: CLASSIFICATION OF MARKOV CHAINS Dosya
  • Lecture 35: MARKOV CHAINS: CONVERGENCE Dosya
  • Lecture 36: STATIONARY DISTRIBUTIONS IN A MARKOV CHAIN Dosya
  • Lecture 37: EXPECTED FIRST PASSAGE TIME Dosya
  • Lecture 38: MARKOV CHAINS WITH REWARDS Dosya
  • Lecture 39: STRONG LAW FOR RENEWAL PROCESSES Dosya
  • Lecture 40: RENEWAL REWARD PROCESSES TIME AVERAGE REWARD Dosya
  • Lecture 41: EXAMPLES RENEWAL REWARD PROCESSES TIME AVERAGE REWARD Dosya
  • Lecture 42: MARTINGALES Dosya
  • Lecture 43: MARTINGALES - 2 Dosya
  • Lecture 44: STOPPING TIMES Dosya
  • Lecture 45: STOPPED MARTINGALES AND WALD'S EQUALITY Dosya
  • Lecture 46: APPLICATION OF WALD'S EQUALITY Dosya