mars-elt/python/mrds_common/CHANGELOG.md

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

[0.6.0] - 13-10-2025

Added

• new type of column xpath_element_id

[0.5.0] - 08-10-2025

Added

• added new mandatory configuration parameter archive_prefix. App now archives source file to this location, before deleting it from inbox_prefix location.
• log app version at runtime.

Changed

• improved logging when calling database function CT_MRDS.FILE_MANAGER.PROCESS_SOURCE_FILE
• removed local zip file deletion from version 0.4.0 to accomodate archiving at the end of the processing

[0.4.1] - 03-10-2025

Added

• --version flag to CLI, now shows package version from mrds.__version__. (#179)

[0.4.0] - 03-10-2025

Added

• App versioning!
• Streaming algorithm when reading, filtering and enriching csv files. This drastically improves application performance in regards to RAM usage.
• Unzipping now deletes local source zip file, after data has been extracted.

[0.3.1] - 30-09-2025

Fixed

• fixed small bug related to the new encoding setting

[0.3.0] - 29-09-2025

Added

• new type of config - Application config. These will be very specific application settings to be overridden in specific cases. Consequently, such configuration will only be optional, because rare usage is expected. First such config is encoding_type

Changed

• removed output of .log files when running the application

Fixed

• small bug when unzipping a file

[0.2.0] - 17-09-2025

Added

• automatic deletion of the source file, and all temporary files created by the app.
• two new cli paramters - --keep-source-file and --keep-tmp-dir flags, to be used to avoid deleting the source file and/or temporary working directory when testing.
• row count output in log files after enrichment.

Fixed

• source and output columns in csv extraction were mistakenly swapped. This is now fixed.