/mides

We create this repo to share all treatment and documentation about the MiDES dataset

Primary LanguageHTML

MiDES

Microdados de Despesas de Entes Subnacionais.

MiDES (Expenditure Microdata of Subnational Entities in English) is a disaggregated and harmonized dataset on public procurement and budget execution by Brazilian municipalities which currently covers around 72% of Brazilian municipalities and spans the years 2002–24. This dataset provides key information that was previously unavailable from aggregate data, such as the identities of suppliers, details on purchases, and granular information on the life cycle of each expenditure action.

Our data is generated from State Audit Courts (TCEs in Portuguese) with standardization efforts. Unlike the data-paper repo, which shows the reproducibility codes for the results of the article MiDES: New Data and Facts from Local Procurement and Budget Execution in Brazil, published in November 2023 with a photograph of the data until then, this repository aims to show the most current work developed with fiscal data.

Data Coverage

State Years Budget data Procurement data Original Source
BA 2010(1) LAI
DF 2009(1) https://www.transparencia.df.gov.br/#/downloads#des
ES 2018(1) LAI
CE 2009(1) https://api.tce.ce.gov.br/
GO 2019(1) https://www.tcmgo.tc.br/pentaho/api/repos/cidadao/app/index.html
MG 2014(1) https://dadosabertos.tce.mg.gov.br/
PB 2003(1) https://dados.tce.pb.gov.br
PE 2013(1) https://sistemas.tce.pe.gov.br/DadosAbertos/Exemplo!listar
PR 2013(1) https://servicos.tce.pr.gov.br/TCEPR/Tribunal/Relacon/Dados/DadosConsulta/Consolidado
RJ 2002(1) https://tce.rj.gov.br/auditormunicipio/Default.aspx
RN 2016(1) https://apidadosabertos.tce.rn.gov.br/swagger/ui/index#/
RO 2019(1)2020 https://transparencia.tce.ro.gov.br/transparenciatce/Remessa/Pesquisar
RS 2010(1) https://dados.tce.rs.gov.br
SC 2015(1) https://servicos.tce.sc.gov.br/farol_externo/index.html
SP 2008(1) https://transparencia.tce.sp.gov.br/conjunto-de-dados
TO 2013(1) https://portaldocidadao.tce.to.gov.br/estadomunicipios/index

Data Access

The data is available on BasedosDados' public data-lake. We follow the methodology of Base dos Dados (Dahis et al., 2022) in harmonization schema and data lake storage. Base dos Dados is a non-profit organization with the mission to universalize access to high-quality data. They provide a platform in Google Cloud with more than 100 treated tables. Between the benefits, we can cross our data with population, GDP, companies, public treasure dataset, etc.
For access database in BigQuery, you can follow these steps to create a personal project and create your queries. The documentation also provides information on how to access the base on other platforms, such as Python, R and Stata. The most simple query example is

SELECT * FROM `basedosdados.world_wb_mides.empenho` LIMIT 100

The result is the 100 first observations of commitment table. Futhermore, the Mides page in Data Basis website shows all tables, variables, and another descriptions necessary to use the dataset. The scripts here provided differents queries that can be reproduced just changing the project_id_bq. We provide another analysis sample in Colab.

Updates

We created this page as a way of keeping the graphs and tables from the article released in Nov/2023 (containing 7 states) as up-to-date as possible (there are currently 13 states). In addition, the treatment codes and all the project documentation are concentrated here.