N8python/Open-Reasoning-Tasks

A comprehensive repository of reasoning tasks for LLMs (and beyond)

Open-Reasoning-Tasks

LLM Reasoning Task Collection

Welcome to the LLM Reasoning Task Collection repository! This project is an open collaboration to create a comprehensive master list of reasoning tasks that can teach, elicit, or show reasoning samples to large language models (LLMs) for training purposes.

Contents

• Open-Reasoning-Tasks
• LLM Reasoning Task Collection
  • Contents
  • Introduction
  • Schema
  • Example Entry
  • Contributing
  • License

Introduction

The goal of this repository is to gather a diverse set of reasoning tasks designed to improve the reasoning capabilities of LLMs. Contributors are encouraged to submit tasks, provide examples, and optionally include diagrams or workflows to illustrate how the tasks function.

Schema

---

Reasoning Task Name

Description: {Text description of the task}

Modality: {whether it is text only, image+text-> text, etc}

Examples:

Example 1:

Input:

Karen is 25. The age to vote is 18. Can Karen vote?

Output:

Yes

---

Example 2:

Input:

Dog's eat bread. Bread comes from wheat. Do dogs eat food made from wheat?

Output:

Yes

---

Diagram (Optional):

{image here}

Citations:

• Citation 1
• Citation 2

Tags:

• Tag 1
• Tag 2
• ...

---

Example Entry

---

Reasoning Task

Description: This task involves providing a series of syllogisms to the model to evaluate its logical reasoning capabilities.

Modality: Text

Examples:

Example 1:

Input:

Karen is 25. The age to vote is 18. Can Karen vote?

Output:

Yes

---

Example 2:

Input:

Dog's eat bread. Bread comes from wheat. Do dogs eat food made from wheat?

Output:

Yes

---

Contributing

We welcome contributions from everyone! To contribute, please see our Contribution Guide.

License

This project is licensed under the Apache 2.0 License. See the LICENSE file for details.