• Markov processes
• Optimal stochastic control
• Linear programming
• Numerical methods for stochastic control
  
• Stochastic stability
• Estimation theory
• Applications: reliability, optimal trajectory generation