Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Jan 13, 2026

• Remove uv.lock file

  dankkom

  committed
  ef432f4

  Copy full SHA for ef432f4

Commits on Jun 8, 2025

• Fix: ensure README.md is correctly referenced in the project metadata

  dankkom

  committed
  191ac46

  Copy full SHA for 191ac46

• Add support for fixing ragged CSV files in the reader module

  dankkom

  committed
  013b13d

  Copy full SHA for 013b13d

• Add more items to NA_VALUES

  dankkom

  committed
  3ad8a6e

  Copy full SHA for 3ad8a6e

• Fix: replace 'continue' by 'return'

  dankkom

  committed
  ddfb30f

  Copy full SHA for ddfb30f

• Refactor CAGED conversion logic, remove year directory in destination path

  dankkom

  committed
  565af2a

  Copy full SHA for 565af2a

• Group RAIS-vinculos data by year when converting to parquet

  dankkom

  committed
  3f80a56

  Copy full SHA for 3f80a56

Commits on May 16, 2025

• Fix typos in column names by updating 'saldo_mov' and 'saldo_movimentacao' to 'saldo_movimento' in CAGED datasets

  dankkom

  committed
  ae64ac2

  Copy full SHA for ae64ac2

Commits on May 15, 2025

• Fix typo in RAIS_VINCULOS_COLUMNS by removing extra whitespace from tipo_estabelecimento

  dankkom

  committed
  2c1d9bb

  Copy full SHA for 2c1d9bb

Commits on May 14, 2025

• Fix destination filepath construction in main function to include dataset directory

  dankkom

  committed
  edb9740

  Copy full SHA for edb9740

• Refactor main function to separate processing of RAIS vinculos and estabelecimentos datasets

  dankkom

  committed
  78a2841

  Copy full SHA for 78a2841

• Remove casting to Categorical in convert_columns_dtypes function for compatibility

  dankkom

  committed
  f821b8b

  Copy full SHA for f821b8b

• Update polars package version to 1.29.0 in uv.lock

  dankkom

  committed
  18e586d

  Copy full SHA for 18e586d

• Add additional NA_VALUES for improved data handling

  dankkom

  committed
  05f49e7

  Copy full SHA for 05f49e7

Commits on Mar 23, 2025

• Add uv.lock file

  dankkom

  committed
  a06a713

  Copy full SHA for a06a713

Commits on Mar 13, 2025

• Enable skipping existing parquet files in the conversion process

  dankkom

  committed
  b66ab4d

  Copy full SHA for b66ab4d

Commits on Mar 8, 2025

• Rename project from pdet-fetcher to pdet-data in pyproject.toml

  dankkom

  committed
  5e62a93

  Copy full SHA for 5e62a93

• Add DOCUMENTACAO.md

  dankkom

  committed
  b9657d2

  Copy full SHA for b9657d2

• Rename package to pdet_data, use src layout

  dankkom

  committed
  001e8da

  Copy full SHA for 001e8da

• Fix logging format in fetch submodule

  dankkom

  committed
  9c0b955

  Copy full SHA for 9c0b955

Commits on Sep 29, 2024

• Update .gitignore

  dankkom

  committed
  d33f845

  Copy full SHA for d33f845

Commits on Sep 26, 2024

• 💫 Sort imports

  dankkom

  committed
  6e613b5

  Copy full SHA for 6e613b5

• Update NA values

  dankkom

  committed
  ef30c18

  Copy full SHA for ef30c18

• Add initial data-wrangling code

  dankkom

  committed
  962c876

  Copy full SHA for 962c876

Commits on Aug 25, 2024

• Remove empty lines

  dankkom

  committed
  8d6d80a

  Copy full SHA for 8d6d80a

• Strip blank spaces in categorical columns

  dankkom

  committed
  9c82316

  Copy full SHA for 9c82316

Commits on Aug 11, 2024

• Improve further the CAGED reader

  dankkom

  committed
  754b3c2

  Copy full SHA for 754b3c2

Commits on Aug 10, 2024

• Improve further dtype conversion, add caged reader

  dankkom

  committed
  526b1db

  Copy full SHA for 526b1db

• Improve reader.parse_filename()

  dankkom

  committed
  9e7e787

  Copy full SHA for 9e7e787

• Separate caged-2020 datasets

  dankkom

  committed
  987296b

  Copy full SHA for 987296b

• Add code to download docs files

  dankkom

  committed
  ca11274

  Copy full SHA for ca11274

Commits on Aug 9, 2024

• Add log messages when fetching files

  dankkom

  committed
  9a2d310

  Copy full SHA for 9a2d310

• Change modification part separator in file name

  dankkom

  committed
  da0f368

  Copy full SHA for da0f368

Commits on Jul 12, 2024

• Refactor: move function decompress() to pdet_fetcher.reader submodule

  dankkom

  committed
  45a6949

  Copy full SHA for 45a6949

Commits on Jun 23, 2024

• Update decompress-convert-rais script

  dankkom

  committed
  9176b19

  Copy full SHA for 9176b19