K-armed algorithms analysis: epsilon-greedy, UCB(upper confidence bounds) greedy with optimistic initialization.