/mahGRs

Government Resolutions of Government of Maharashtra, obtained from https://gr.maharashtra.gov.in/1145/Government-Resolutions

Primary LanguagePythonMIT LicenseMIT

Government Resolutions, Government of Maharashtra

This repository contains government resolutions issued by the Government of Maharashtra for the last five years, there are two files for each resolution 1) original marathi (txt file) and 2) english translation of that resolution (txt file). The original government resolutions can be found at https://gr.maharashtra.gov.in/1145/Government-Resolutions.

The English translation is obtained by processing each the pdf file of each Government Resolution through a pipeline where the following operations are performed 1) Download the file using crawler 2) OCR to handle non-standard fonts 3) paragraph detection 4) table detection 5) translation to English. This pipeline is run in sepearate repositories check out orgpedia/mah* for each department.

Data Details

Num Department Name Start Date Last Date # Marathi Orders # Translated Orders Starting Order Last Order
1 Agriculture, Dairy Development, Animal Husbandry and Fisheries Department 16 Mar 2018 23 Aug 2024 4068 4068 201803161624182101.pdf mr en 202408231239016101.pdf mr en
2 Co-operation, Textiles and Marketing Department 19 Mar 2018 23 Aug 2024 2474 2474 201803191257576702.pdf mr en 202408231209508802.pdf mr en
3 Environment Department 02 Dec 2017 21 Aug 2024 547 547 201712041147216904.pdf mr en 202408221210334704.pdf mr en
4 Finance Department 14 Jan 2021 22 Aug 2024 701 701 202101141237329905.pdf mr en 202408221157534405.pdf mr en
5 Food, Civil Supplies and Consumer Protection Department 05 Feb 2018 23 Aug 2024 1034 1034 201802121244545806.pdf mr en 202408231315098706.pdf mr en
6 General Administration Department 16 Mar 2018 23 Aug 2024 4533 4533 201803161224022707.pdf mr en 202408231157380007.pdf mr en
7 Higher and Technical Education Department 12 Oct 2017 23 Aug 2024 2664 2664 201710121514029708.pdf mr en 202408231728398508.pdf mr en
8 Home Department 22 Oct 2008 23 Aug 2024 4067 4067 20081022.pdf mr en 202408231712040629.pdf mr en
9 Housing Department 16 Nov 2017 28 Mar 2024 352 352 201711161447076609.pdf mr en 202403281255554909.pdf mr en
10 Industries, Energy and Labour Department 15 Mar 2018 23 Aug 2024 1952 1952 201803151204055010.pdf mr en 202408231518332310.pdf mr en
11 Information Technology Department 20 Jan 2018 05 Mar 2024 111 111 201801201843024511.pdf mr en 202403051249430211.pdf mr en
12 Law and Judiciary Department 17 Mar 2018 23 Aug 2024 1861 1861 201803171129290212.pdf mr en 202408231709393512.pdf mr en
13 Marathi Language Department 22 Feb 2018 23 Aug 2024 333 333 201802031549154233.pdf mr en 202408231451352133.pdf mr en
14 Medical Education and Drugs Department 12 Mar 2018 21 Aug 2024 1226 1226 201803121137094813.pdf mr en 202408211139128413.pdf mr en
15 Minorities Development Department 09 Mar 2018 22 Aug 2024 959 959 201803091218355314.pdf mr en 202408221247124114.pdf mr en
16 Other Backward Bahujan Welfare Department 07 Mar 2022 21 Aug 2024 919 919 202203081752439334.pdf mr en 202408211553445634.pdf mr en
17 Parliamentary Affairs Department 12 Oct 2017 27 Feb 2024 106 106 201710031642378615.pdf mr en 202402271500283915.pdf mr en
18 Persons with Disabilities Welfare Department 04 Jan 2023 21 Aug 2024 77 77 202301041906309635.pdf mr en 202408211521024435.pdf mr en
19 Planning Department 09 Mar 2018 23 Aug 2024 1599 1599 201803091441032716.pdf mr en 202408231446561516.pdf mr en
20 Public Health Department 08 Feb 2018 23 Aug 2024 5851 5851 201801311722275417.pdf mr en 202408231124343917.pdf mr en
21 Public Works Department 05 Mar 2018 23 Aug 2024 3078 3078 201803051515468118.pdf mr en 202408231824593918.pdf mr en
22 Revenue and Forest Department 23 Mar 2021 23 Aug 2024 3920 3920 202103231328393119.pdf mr en 202408231738578019.pdf mr en
23 Rural Development Department 31 Mar 2021 22 Aug 2024 1622 1622 202103301021181120.pdf mr en 202408221723338920.pdf mr en
24 School Education and Sports Department 15 May 2018 23 Aug 2024 3897 3897 201805161114241221.pdf mr en 202408231809497621.pdf mr en
25 Skill Development and Entrepreneurship Department 17 Mar 2018 16 Aug 2024 946 946 201803171322099003.pdf mr en 202408161257588003.pdf mr en
26 Social Justice and Special Assistance Department 03 Dec 2019 22 Aug 2024 1375 1375 201912051107011622.pdf mr en 202408231111346622.pdf mr en
27 Soil and Water Conservation Department 16 Mar 2018 23 Aug 2024 2053 2053 201803161247582426.pdf mr en 202408231803543926.pdf mr en
28 Tourism and Cultural Affairs Department 14 Mar 2018 21 Aug 2024 1332 1332 201803131542054523.pdf mr en 202408221516357823.pdf mr en
29 Tribal Development Department 14 Mar 2018 21 Aug 2024 1938 1938 201803091105184924.pdf mr en 202408071027322324.pdf mr en
30 Urban Development Department 07 Mar 2018 22 Aug 2024 2660 2660 201803071203178325.pdf mr en 202408221541287925.pdf mr en
31 Water Resources Department 09 Mar 2018 21 Aug 2024 2816 2816 201803091034435527.pdf mr en 202408211718434327.pdf mr en
32 Water Supply and Sanitation Department 13 Mar 2018 22 Aug 2024 3624 3624 201803121414108428.pdf mr en 202408221058504128.pdf mr en
33 Women and Child Development Department 17 Mar 2018 23 Aug 2024 1312 1312 201803171539444330.pdf mr en 202408231435314830.pdf mr en

Total Orders: 66,007 and Total Translated Orders: 66,007

Accessing Data

The easist way to access the data is to clone the repository or download the data as a zip file (Click the green button '< > Code' at the top. All the files are arranged as per department and are in the GRs directory.

Please note that the repository even though it contains only txt file is about 1GB in size.

Running Chatbot

You can run a simple Q & A chatbot on this data using chat.py, a simple chat applications that has no external depedencies and requires you to run Qdrant vector database, have need to have curl on your machine and have an OpenAI API Key.

Start qdrant on your local machine

docker pull qdrant/qdrant
docker run -p 6333:6333 qdrant/qdrant

Provide Open AI API Key, this chat app uses two APIs embeddings and completions.

export OPENAI_API_KEY='XXX'

This will start the chat app on all the orders (GRs) that have 'library' keyword in their subject.

python chat.py GRs/Higher_and_Technical_Education_Department library

screenshot of running chat.py

  • You get clickable links in references if you run in iTerm2 *.

Thanks

Orgpedia would like to thank AI4Bharat for releasing IndicTrans2.

Thanks to its accuracy and performance Orgpedia was able to translate over 50,000 documents relatively quickly and at a fraction of the price of the online servicess.