Grzegorz Michalski
1385bfb9e7
feat: Implement MARS-1409 post-hook for backfilling A_WORKFLOW_HISTORY_KEY
...
- Added .gitignore to exclude temporary folders.
- Created SQL script to update existing A_WORKFLOW_HISTORY_KEY in A_SOURCE_FILE_RECEIVED.
- Implemented rollback script to clear backfilled A_WORKFLOW_HISTORY_KEY values.
- Added README.md for installation and usage instructions.
- Developed master installation and rollback scripts for MARS-1409 post-hook.
- Verified installation and rollback processes with detailed checks.
- Updated trigger logic to manage workflow history updates.
- Ensured proper version tracking and verification for related packages.
2026-03-13 08:30:32 +01:00
Grzegorz Michalski
202b535f9f
Update DATA_EXPORTER package to v2.17.0: Fix RFC 4180 compliance and Parquet format corruption
2026-03-12 08:50:08 +01:00
Grzegorz Michalski
5ba6c30fda
MARS-1005-PREHOOK
2026-03-11 10:34:47 +01:00
Grzegorz Michalski
64a4b9a2f0
Refactor rollback script to delete specific legacy files and adjust object URI construction
2026-03-09 11:46:01 +01:00
Grzegorz Michalski
dec3e7137e
Refactor rollback script to delete only files registered by MARS-1005 and improve output messages
2026-03-09 10:24:24 +01:00
Grzegorz Michalski
0ecc119ee9
Refactor data integrity verification script to use A_ETL_LOAD_SET_FK instead of A_WORKFLOW_HISTORY_KEY
2026-03-09 09:31:30 +01:00
Grzegorz Michalski
182e6240d3
Update export script comments for clarity and consistency
2026-03-09 09:25:20 +01:00
Grzegorz Michalski
b81e524351
Refactor MARS-1005 scripts for OU_TOP legacy data export and rollback
...
- Updated SQL scripts to verify data integrity for 6 OU_TOP.LEGACY_* tables instead of 3 C2D MPEC tables.
- Modified rollback script to delete exported CSV files from ODS/TOP/ bucket paths.
- Enhanced verification script to check for remaining files and cloud bucket contents specific to MARS-1005.
- Adjusted install script to reflect changes in target tables and their corresponding paths in the ODS bucket.
- Updated README to include instructions for the new MARS-1005 installation and rollback processes.
2026-03-06 14:34:12 +01:00
Grzegorz Michalski
73e99b6e76
MARS-1005
2026-03-06 12:06:18 +01:00
Grzegorz Michalski
113ea0a618
Refactor MARS-1409 SQL scripts for workflow history key management
...
- Added checks for existing columns before adding or dropping A_WORKFLOW_HISTORY_KEY in relevant scripts to prevent errors.
- Updated rollback scripts to ensure proper restoration of previous states, including recompilation of dependent packages.
- Introduced a diagnostic script to assess the status of workflow keys against ODS tables, providing detailed reporting on discrepancies.
- Adjusted trigger definitions to accommodate new workflow names and ensure correct handling of workflow history.
- Modified master rollback script to streamline the rollback process and improve clarity in step descriptions.
2026-03-05 12:33:59 +01:00
Grzegorz Michalski
59e18d9b35
Add error handling for TRG_A_WORKFLOW_HISTORY trigger installation
2026-03-04 10:16:35 +01:00
Grzegorz Michalski
b537719b64
added template tables
2026-03-03 09:47:24 +01:00
Grzegorz Michalski
4de14b64fb
rmemove unneeded
2026-03-03 09:46:06 +01:00
Grzegorz Michalski
cad6e63479
exported files from dev
2026-03-02 13:51:59 +01:00
Grzegorz Michalski
7db10725a0
MARS-1409
2026-03-02 10:15:22 +01:00
Grzegorz Michalski
1c6f552df9
szkielet paczki MARS-1409
2026-02-27 07:32:21 +01:00
Grzegorz Michalski
e9d4056451
Merge develop into main - DATA_EXPORTER v2.14.0 optimization
2026-02-26 20:39:33 +01:00
Grzegorz Michalski
60b218d211
Hotfix - Add filtering for successful workflows in archival queries
2026-02-26 20:37:03 +01:00
Grzegorz Michalski
819b6f7880
Update version history in FILE_MANAGER package to include changes for MARS-828 compatibility
2026-02-25 09:50:30 +01:00
Grzegorz Michalski
c68d5bfe2c
feat(MARS-835): Enhance EXPORT_PARTITION_PARALLEL with pTaskName parameter for session isolation and optimize chunk retrieval logic
2026-02-25 09:49:25 +01:00
Grzegorz Michalski
c607bbe26e
Update CSDB DEBT tables to set MINIMUM_AGE_MONTHS to 0 for current month only
2026-02-25 07:00:04 +01:00
Grzegorz Michalski
1569237306
Add T2_PEAK_LIQUIDITY_NEED template table with column comments
2026-02-24 19:20:28 +01:00
Grzegorz Michalski
472a724fe0
Update FILE_MANAGER package to version 3.5.1; fix TIMESTAMP field syntax for SQL*Loader compatibility and add T2_PEAK_LIQUIDITY_NEED template table
2026-02-24 19:19:45 +01:00
Grzegorz Michalski
04d4f6ac02
feat(MARS-835): Update export scripts to support HIST-only strategy, including verification and rollback adjustments
2026-02-24 19:18:16 +01:00
Grzegorz Michalski
ca5d8b320c
feat(MARS-835): Enhance DELETE_FAILED_EXPORT_FILE procedure to delete all matching files before retrying export, preventing data duplication in parallel processing
2026-02-24 09:38:09 +01:00
Grzegorz Michalski
2605896469
refactor(EXPORT): Improve formatting and logging
2026-02-24 08:22:42 +01:00
Grzegorz Michalski
b588b0bb72
Add FILE_MANAGER package installation and rollback scripts; update installation process for compatibility with MARS-828
2026-02-23 09:14:20 +01:00
Grzegorz Michalski
6060f93fde
wk
2026-02-20 15:23:12 +01:00
Grzegorz Michalski
99aca3af40
wk1
2026-02-20 15:22:58 +01:00
Grzegorz Michalski
1089184367
wk1
2026-02-20 15:18:08 +01:00
Grzegorz Michalski
e538706896
feat(MARS-826): Add pTemplateTableName parameter to export scripts for various tables
2026-02-20 15:16:37 +01:00
Grzegorz Michalski
ff034fcd68
MARS-1057
2026-02-20 15:08:18 +01:00
Grzegorz Michalski
b85172ae84
wk1
2026-02-20 14:25:19 +01:00
Grzegorz Michalski
577c94f363
Zmiana nazw kolumn
...
ARCHIVE_ENABLED → IS_ARCHIVE_ENABLED (konwencja boolean)
KEEP_IN_TRASH → IS_KEEP_IN_TRASH (konwencja boolean)
2026-02-20 11:56:41 +01:00
Grzegorz Michalski
866b886c70
Merge develop into main - added pJobClass parameter and MARS-826, MARS-835, MARS-828 updates
2026-02-20 10:09:37 +01:00
Grzegorz Michalski
3848a9471b
Add pJobClass parameter to export scripts for Oracle Scheduler resource management
2026-02-19 11:26:51 +01:00
Grzegorz Michalski
cafa30f8f3
refactor(FILE_MANAGER): Update schema reference handling for grants and table operations
2026-02-19 08:58:39 +01:00
Grzegorz Michalski
a0f4146a24
refactor(FILE_MANAGER): Update privilege handling to use dynamic schema reference
2026-02-19 07:35:49 +01:00
Grzegorz Michalski
2b116c0256
feat(MARS-1057): Upgrade FILE_MANAGER to v3.5.0 with area filter functionality
...
- Updated install script to reflect new version and features.
- Added pArea parameter to CREATE_EXTERNAL_TABLES_SET and CREATE_EXTERNAL_TABLES_BATCH procedures for selective table creation (INBOX/ODS/ARCHIVE/ALL).
- Enhanced grant preservation logic based on the pArea parameter.
- Updated FILE_MANAGER_ODS package to support new functionality.
- Modified rollback script to remove new features and revert to previous versions.
2026-02-18 14:03:11 +01:00
Grzegorz Michalski
204616252a
Add pRestoreGrants parameter to CREATE_EXTERNAL_TABLES_SET for grant preservation during table recreation
2026-02-18 13:27:12 +01:00
Grzegorz Michalski
2143a81aa0
Add pJobClass parameter to MARS-835 export scripts for Oracle Scheduler resource management
2026-02-18 12:58:18 +01:00
Grzegorz Michalski
b6cf54f103
Add JOB_CLASS parameter to DATA_EXPORTER for Oracle Scheduler support
2026-02-18 12:58:06 +01:00
Grzegorz Michalski
6ade77c3c0
Update DATA_EXPORTER package to version 2.10.1, fixing redundant deletion of COMPLETED chunks before parallel export to prevent ORA-01403 errors.
2026-02-17 12:03:36 +01:00
Grzegorz Michalski
8ce07c3360
Add grant and rollback scripts for EXECUTE privilege on T_FILENAME to MRDS_LOADER
2026-02-17 12:03:21 +01:00
Grzegorz Michalski
64dc830a2b
Add 'VALIDATION_FAILED' status to A_SOURCE_FILE_RECEIVED constraint for improved status handling
2026-02-17 11:54:07 +01:00
Grzegorz Michalski
020dacb571
Refactor MARS-835 installation scripts to include explicit date handling and remove obsolete files
2026-02-17 11:12:03 +01:00
Grzegorz Michalski
057a4e7ce3
Enhance trigger validation in MARS-828 verification script to improve error handling and output clarity
2026-02-16 11:01:44 +01:00
Grzegorz Michalski
a9a51f19be
Rename ARCH_FILE_NAME to ARCH_PATH in FILE_ARCHIVER for clarity and consistency in directory URI handling
2026-02-16 11:01:01 +01:00
Grzegorz Michalski
912b7a6466
Remove recent export activity logging from C2D MPEC historical data export script
2026-02-13 21:06:15 +01:00
Grzegorz Michalski
b6f6446232
Add author information to MARS-828 installation script
2026-02-13 21:05:09 +01:00
