Optimization numerical optimization from scratch Linear and nonlinear optimization Steepest descent gradient method, Newton method, simulated annealing Numerical error numerical error from both float point number representation error and numerical approximation error