rain-1/gpt-incontextlearning-experiments

gpt-incontextlearning-experiments

• Problem 1: logic gate Horse and April gives November
• Problem 2: syntax tree (sentence (np (det the) (noun rat)) (vp (verb ate) (noun cheese)))
• Problem 3: semantic grouping ['lion', 'giraffe'], ['iron', 'gold']
• Problem 4: natural substitution The coffee was nice and hot
• Problem 5: -
• Problem 6: parity 001011 -> 1
• Problem 7: wonderland recall “Exactly so,” said Alice.

References

• https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tracing-Emergent-Abilities-of-Language-Models-to-their-Sources-b9a57ac0fcf74f30a1ab9e3e36fa1dc1

Thank you

Thanks to https://nat.dev for GPT-4 access! This helps me explore ICL.