Commit Graph

158 Commits

Author SHA1 Message Date
Grzegorz Michalski
a3ec31341b Update DATA_EXPORTER package to version 2.8.1, fix query in EXPORT_TABLE_DATA to ensure single file output, and update version history. 2026-02-12 16:31:00 +01:00
Grzegorz Michalski
6039d6bce4 Update DATA_EXPORTER package to version 2.8.0, refactor EXPORT_TABLE_DATA to export to a single CSV file, and add pFileName and pMaxFileSize parameters. 2026-02-12 09:56:57 +01:00
Grzegorz Michalski
a7d286b1e6 Refactor MARS-956 package for C2D MPEC data export
- Updated README.md to enhance clarity on the one-time export process, including detailed prerequisites, data structure, and validation steps.
- Revised install_mars956.sql to streamline installation commands and improve logging mechanisms.
- Modified rollback_mars956.sql to include user confirmation before proceeding with deletions and to clarify rollback steps.
- Removed unnecessary tracking and validation scripts (track_package_versions.sql, validate_export.sql, verify_packages_version.sql) to simplify the package structure.
- Enhanced error handling and validation checks throughout the installation and rollback processes.
2026-02-12 09:56:37 +01:00
Grzegorz Michalski
f2bcdb3a76 ignore 2026-02-12 09:28:54 +01:00
Grzegorz Michalski
15dafbff2a zachowanie wersj 2.7.5 2026-02-12 09:27:57 +01:00
Grzegorz Michalski
3261aa1a6d wk 2026-02-11 23:05:51 +01:00
Grzegorz Michalski
1327410880 Fix URI construction in ARCHIVE_TABLE_DATA procedure to include 'ARCHIVE' directory for correct file path. 2026-02-11 21:53:31 +01:00
Grzegorz Michalski
f4e9fb9cb2 Merge branch 'develop' 2026-02-11 21:32:47 +01:00
Grzegorz Michalski
f8213b76ab Refactor export scripts to use DATA_EXPORTER.EXPORT_TABLE_DATA procedure, update folder structure to DATA/C2D, and add file registration validation in README and validation script. 2026-02-11 21:22:37 +01:00
Grzegorz Michalski
641af7415f Update DATA_EXPORTER package to version 2.7.5, adding pRegisterExport parameter to EXPORT_TABLE_DATA procedure for file registration in A_SOURCE_FILE_RECEIVED. 2026-02-11 20:32:21 +01:00
Grzegorz Michalski
c1c3890a1a pierwsza wersja paczki MARS-956 2026-02-11 20:24:45 +01:00
Grzegorz Michalski
63ed05930e Enhance EXPORT_TABLE_DATA procedure by adding pTemplateTableName parameter for flexible column order and date formatting. Update version history for clarity on recent changes. 2026-02-11 19:46:28 +01:00
Grzegorz Michalski
5320db627b przygotowanie pod nowe zmiany 2026-02-11 19:04:06 +01:00
Grzegorz Michalski
3171ff2ddf Update DATA_EXPORTER package to version 2.7.4, enhancing filename storage and metadata retrieval logic for exported files. 2026-02-11 18:27:44 +01:00
Grzegorz Michalski
26aba08759 Add FILE_ARCHIVER package and enhance A_SOURCE_FILE_CONFIG table
- Created new FILE_ARCHIVER package (v3.2.1) for managing file archival processes, including procedures for archiving, restoring, and purging files.
- Added versioning and build information to the package with detailed version history.
- Enhanced A_SOURCE_FILE_CONFIG table by adding ARCHIVE_ENABLED and KEEP_IN_TRASH columns to control archival participation and TRASH retention policy.
- Implemented constraints and comments for new columns to ensure data integrity and provide clarity on their usage.
2026-02-11 18:24:18 +01:00
Grzegorz Michalski
d237c2d7aa pRegisterExport 2026-02-11 09:54:04 +01:00
Grzegorz Michalski
96e3e2f845 pRegisterExport 2026-02-11 09:53:53 +01:00
Grzegorz Michalski
3eb39091de dodanie: pRegisterExport => TRUE 2026-02-11 09:49:28 +01:00
Grzegorz Michalski
113b9f55e3 deprecated version 2.8.0 2026-02-11 09:45:11 +01:00
Grzegorz Michalski
b96becd8ef Add autonomous transaction pragma to ARCHIVE_TABLE_DATA and GATHER_TABLE_STAT procedures for improved transaction handling 2026-02-11 07:36:52 +01:00
Grzegorz Michalski
b1bb24e487 Refactor file retrieval logic in ARCHIVE_TABLE_DATA and GATHER_TABLE_STAT procedures to simplify queries and enhance clarity 2026-02-10 14:03:52 +01:00
Grzegorz Michalski
86535048fc Add TRASH folder management procedures for restoring and purging files 2026-02-10 13:53:12 +01:00
Grzegorz Michalski
9ffad718fe Update FILE_ARCHIVER package to version 3.2.1, fixing status update from ARCHIVED to ARCHIVED_AND_TRASHED for files moved to TRASH folder 2026-02-10 13:18:17 +01:00
Grzegorz Michalski
6c8b22eac9 Add DATA_EXPORTER package and update installation scripts for export registration
- Created new package CT_MRDS.DATA_EXPORTER (v2.6.3) for comprehensive data export capabilities, including CSV and Parquet formats with OCI integration.
- Implemented version history tracking and enhanced error handling for export processes.
- Updated installation scripts to include pRegisterExport parameter for registering exports in A_WORKFLOW_HISTORY and A_SOURCE_FILE_RECEIVED.
2026-02-10 09:33:46 +01:00
Grzegorz Michalski
d443c4f07d Update FILE_ARCHIVER package to version 3.2.0 with TRASH retention control and new statuses 2026-02-10 08:23:06 +01:00
Grzegorz Michalski
cdd9dff32d aktualizacja dokumentacji w związku z TRASH i nowymi statusami plików. 2026-02-10 08:21:51 +01:00
Grzegorz Michalski
70909ba8c4 Enhance FILE_ARCHIVER package to include ODS bucket URI retrieval and update insert statements for A_TABLE_STAT_HIST and A_TABLE_STAT 2026-02-09 13:42:50 +01:00
Grzegorz Michalski
88325f0b8c Refactor FILE_ARCHIVER package to use CT_MRDS.ENV_MANAGER consistently for logging and parameter formatting 2026-02-09 11:04:33 +01:00
Grzegorz Michalski
dc8031262c konfiguracja 2026-02-09 10:22:38 +01:00
Grzegorz Michalski
fc95b12c9e Remove test scenarios for archival strategies from test_archival_strategies.sql 2026-02-09 09:40:31 +01:00
Grzegorz Michalski
23b9962128 Update ARCHIVE_TABLE_DATA procedure to use GROUP BY instead of DISTINCT to resolve ORA-22950 issue 2026-02-09 09:36:05 +01:00
Grzegorz Michalski
802c102f29 Refactor archival strategy logic in FILE_ARCHIVER package to enhance clarity and support for age-based archiving 2026-02-09 09:12:49 +01:00
Grzegorz Michalski
fa1f179be9 gitignore 2026-02-09 08:13:26 +01:00
Grzegorz Michalski
293f2873b7 dokumentacja testow 2026-02-09 07:49:12 +01:00
Grzegorz Michalski
5e9233649e Merge 3.3.1 into 3.4.0 (MARS-1046 into MARS-1057) 2026-02-06 14:08:14 +01:00
Grzegorz Michalski
974f6eca25 Update FILE_ARCHIVER package to version 3.1.2 with enhanced archival strategies and fixes 2026-02-06 11:45:57 +01:00
Grzegorz Michalski
c4f5ba48bc wk 2026-02-06 11:41:25 +01:00
Grzegorz Michalski
e6ab189dc9 Refactor archival strategies in FILE_ARCHIVER package
- Removed CURRENT_MONTH_ONLY strategy, replacing it with MINIMUM_AGE_MONTHS = 0 for current month retention.
- Updated validation logic to allow MINIMUM_AGE_MONTHS to be non-negative.
- Consolidated documentation to reflect changes in archival strategies.
- Adjusted rollback script to reset all archival parameters to NULL for 25 Release 01 tables.
- Enhanced README and installation scripts to clarify new configuration requirements and usage examples.
- Updated version history to indicate breaking changes and migration steps for existing configurations.
2026-02-05 20:17:51 +01:00
Grzegorz Michalski
e93140e962 zmiany w pakiecie 2026-02-05 11:03:15 +01:00
Grzegorz Michalski
f42777f480 dokumentacja 2026-02-05 10:54:48 +01:00
Grzegorz Michalski
19925603fa aktualizacja definicji 2026-02-04 14:41:30 +01:00
Grzegorz Michalski
569c647b6c dopracowanie paczki 2026-02-04 12:22:33 +01:00
Grzegorz Michalski
8a162ce9bf dok 2026-02-04 12:21:48 +01:00
Grzegorz Michalski
7864c568d7 Cleanup: Remove old REL01_POST_DEACTIVATION folders after merge from main 2026-02-04 10:58:04 +01:00
Grzegorz Michalski
c508e1e4e2 Refactor archival strategy rollback scripts for Release 01 tables 2026-02-03 19:39:08 +01:00
Grzegorz Michalski
d6fd0b3dbd Add scripts for configuring and rolling back archival strategies for Release 01 tables 2026-02-03 19:02:32 +01:00
Grzegorz Michalski
32c7a5dcee wk 2026-02-03 18:38:17 +01:00
Grzegorz Michalski
76c8ce6cc7 change rollback folder name 2026-02-03 14:00:47 +01:00
Grzegorz Michalski
64965fb8c8 MARS-828 2026-02-03 13:51:13 +01:00
Grzegorz Michalski
d17d71031a wk 2026-02-03 13:33:45 +01:00