Grzegorz Michalski
896e67bcb9
feat: Refactor A_SOURCE_FILE_CONFIG table structure and update comments for clarity
2026-03-17 10:58:01 +01:00
Grzegorz Michalski
ad5a6f393a
feat: Update installation script to reflect expected duration for MARS-1409 post-hook process
2026-03-17 09:54:42 +01:00
Grzegorz Michalski
a4ac132b76
feat: Implement MARS-1409 changes to add ARCHIVAL_STRATEGY and ARCH_MINIMUM_AGE_MONTHS columns to A_TABLE_STAT and A_TABLE_STAT_HIST, and update FILE_ARCHIVER for handling these new fields
2026-03-17 08:23:14 +01:00
Grzegorz Michalski
6468d12349
minor
2026-03-13 13:51:53 +01:00
Grzegorz Michalski
fe0f7bce18
feat: Enhance FILE_ARCHIVER package to handle empty ODS bucket scenarios with improved statistics initialization
2026-03-13 13:34:38 +01:00
Grzegorz Michalski
6b2f60f413
feat: Update FILE_ARCHIVER package to version 3.3.1 with improved handling for empty ODS bucket scenarios
2026-03-13 11:40:19 +01:00
Grzegorz Michalski
ca11debd93
minor
2026-03-13 11:35:11 +01:00
Grzegorz Michalski
24e6bce18c
minor changes
2026-03-13 11:34:59 +01:00
Grzegorz Michalski
aa03dd1616
feat: Update FILE_MANAGER package to version 3.6.1 with fixes for CHAR/NCHAR/NVARCHAR2 column definitions
2026-03-13 09:11:28 +01:00
Grzegorz Michalski
096994d514
feat: Add diagnostic script for workflow key status in MARS-1409 post-hook
2026-03-13 08:43:14 +01:00
Grzegorz Michalski
1385bfb9e7
feat: Implement MARS-1409 post-hook for backfilling A_WORKFLOW_HISTORY_KEY
...
- Added .gitignore to exclude temporary folders.
- Created SQL script to update existing A_WORKFLOW_HISTORY_KEY in A_SOURCE_FILE_RECEIVED.
- Implemented rollback script to clear backfilled A_WORKFLOW_HISTORY_KEY values.
- Added README.md for installation and usage instructions.
- Developed master installation and rollback scripts for MARS-1409 post-hook.
- Verified installation and rollback processes with detailed checks.
- Updated trigger logic to manage workflow history updates.
- Ensured proper version tracking and verification for related packages.
2026-03-13 08:30:32 +01:00
Grzegorz Michalski
202b535f9f
Update DATA_EXPORTER package to v2.17.0: Fix RFC 4180 compliance and Parquet format corruption
2026-03-12 08:50:08 +01:00
Grzegorz Michalski
5ba6c30fda
MARS-1005-PREHOOK
2026-03-11 10:34:47 +01:00
Grzegorz Michalski
64a4b9a2f0
Refactor rollback script to delete specific legacy files and adjust object URI construction
2026-03-09 11:46:01 +01:00
Grzegorz Michalski
dec3e7137e
Refactor rollback script to delete only files registered by MARS-1005 and improve output messages
2026-03-09 10:24:24 +01:00
Grzegorz Michalski
0ecc119ee9
Refactor data integrity verification script to use A_ETL_LOAD_SET_FK instead of A_WORKFLOW_HISTORY_KEY
2026-03-09 09:31:30 +01:00
Grzegorz Michalski
182e6240d3
Update export script comments for clarity and consistency
2026-03-09 09:25:20 +01:00
Grzegorz Michalski
b81e524351
Refactor MARS-1005 scripts for OU_TOP legacy data export and rollback
...
- Updated SQL scripts to verify data integrity for 6 OU_TOP.LEGACY_* tables instead of 3 C2D MPEC tables.
- Modified rollback script to delete exported CSV files from ODS/TOP/ bucket paths.
- Enhanced verification script to check for remaining files and cloud bucket contents specific to MARS-1005.
- Adjusted install script to reflect changes in target tables and their corresponding paths in the ODS bucket.
- Updated README to include instructions for the new MARS-1005 installation and rollback processes.
2026-03-06 14:34:12 +01:00
Grzegorz Michalski
73e99b6e76
MARS-1005
2026-03-06 12:06:18 +01:00
Grzegorz Michalski
113ea0a618
Refactor MARS-1409 SQL scripts for workflow history key management
...
- Added checks for existing columns before adding or dropping A_WORKFLOW_HISTORY_KEY in relevant scripts to prevent errors.
- Updated rollback scripts to ensure proper restoration of previous states, including recompilation of dependent packages.
- Introduced a diagnostic script to assess the status of workflow keys against ODS tables, providing detailed reporting on discrepancies.
- Adjusted trigger definitions to accommodate new workflow names and ensure correct handling of workflow history.
- Modified master rollback script to streamline the rollback process and improve clarity in step descriptions.
2026-03-05 12:33:59 +01:00
Grzegorz Michalski
59e18d9b35
Add error handling for TRG_A_WORKFLOW_HISTORY trigger installation
2026-03-04 10:16:35 +01:00
Grzegorz Michalski
b537719b64
added template tables
2026-03-03 09:47:24 +01:00
Grzegorz Michalski
4de14b64fb
rmemove unneeded
2026-03-03 09:46:06 +01:00
Grzegorz Michalski
cad6e63479
exported files from dev
2026-03-02 13:51:59 +01:00
Grzegorz Michalski
7db10725a0
MARS-1409
2026-03-02 10:15:22 +01:00
Grzegorz Michalski
1c6f552df9
szkielet paczki MARS-1409
2026-02-27 07:32:21 +01:00
Grzegorz Michalski
e9d4056451
Merge develop into main - DATA_EXPORTER v2.14.0 optimization
2026-02-26 20:39:33 +01:00
Grzegorz Michalski
60b218d211
Hotfix - Add filtering for successful workflows in archival queries
2026-02-26 20:37:03 +01:00
Grzegorz Michalski
819b6f7880
Update version history in FILE_MANAGER package to include changes for MARS-828 compatibility
2026-02-25 09:50:30 +01:00
Grzegorz Michalski
c68d5bfe2c
feat(MARS-835): Enhance EXPORT_PARTITION_PARALLEL with pTaskName parameter for session isolation and optimize chunk retrieval logic
2026-02-25 09:49:25 +01:00
Grzegorz Michalski
c607bbe26e
Update CSDB DEBT tables to set MINIMUM_AGE_MONTHS to 0 for current month only
2026-02-25 07:00:04 +01:00
Grzegorz Michalski
1569237306
Add T2_PEAK_LIQUIDITY_NEED template table with column comments
2026-02-24 19:20:28 +01:00
Grzegorz Michalski
472a724fe0
Update FILE_MANAGER package to version 3.5.1; fix TIMESTAMP field syntax for SQL*Loader compatibility and add T2_PEAK_LIQUIDITY_NEED template table
2026-02-24 19:19:45 +01:00
Grzegorz Michalski
04d4f6ac02
feat(MARS-835): Update export scripts to support HIST-only strategy, including verification and rollback adjustments
2026-02-24 19:18:16 +01:00
Grzegorz Michalski
ca5d8b320c
feat(MARS-835): Enhance DELETE_FAILED_EXPORT_FILE procedure to delete all matching files before retrying export, preventing data duplication in parallel processing
2026-02-24 09:38:09 +01:00
Grzegorz Michalski
2605896469
refactor(EXPORT): Improve formatting and logging
2026-02-24 08:22:42 +01:00
Grzegorz Michalski
b588b0bb72
Add FILE_MANAGER package installation and rollback scripts; update installation process for compatibility with MARS-828
2026-02-23 09:14:20 +01:00
Grzegorz Michalski
6060f93fde
wk
2026-02-20 15:23:12 +01:00
Grzegorz Michalski
99aca3af40
wk1
2026-02-20 15:22:58 +01:00
Grzegorz Michalski
1089184367
wk1
2026-02-20 15:18:08 +01:00
Grzegorz Michalski
e538706896
feat(MARS-826): Add pTemplateTableName parameter to export scripts for various tables
2026-02-20 15:16:37 +01:00
Grzegorz Michalski
ff034fcd68
MARS-1057
2026-02-20 15:08:18 +01:00
Grzegorz Michalski
b85172ae84
wk1
2026-02-20 14:25:19 +01:00
Grzegorz Michalski
577c94f363
Zmiana nazw kolumn
...
ARCHIVE_ENABLED → IS_ARCHIVE_ENABLED (konwencja boolean)
KEEP_IN_TRASH → IS_KEEP_IN_TRASH (konwencja boolean)
2026-02-20 11:56:41 +01:00
Grzegorz Michalski
866b886c70
Merge develop into main - added pJobClass parameter and MARS-826, MARS-835, MARS-828 updates
2026-02-20 10:09:37 +01:00
Grzegorz Michalski
3848a9471b
Add pJobClass parameter to export scripts for Oracle Scheduler resource management
2026-02-19 11:26:51 +01:00
Grzegorz Michalski
cafa30f8f3
refactor(FILE_MANAGER): Update schema reference handling for grants and table operations
2026-02-19 08:58:39 +01:00
Grzegorz Michalski
a0f4146a24
refactor(FILE_MANAGER): Update privilege handling to use dynamic schema reference
2026-02-19 07:35:49 +01:00
Grzegorz Michalski
2b116c0256
feat(MARS-1057): Upgrade FILE_MANAGER to v3.5.0 with area filter functionality
...
- Updated install script to reflect new version and features.
- Added pArea parameter to CREATE_EXTERNAL_TABLES_SET and CREATE_EXTERNAL_TABLES_BATCH procedures for selective table creation (INBOX/ODS/ARCHIVE/ALL).
- Enhanced grant preservation logic based on the pArea parameter.
- Updated FILE_MANAGER_ODS package to support new functionality.
- Modified rollback script to remove new features and revert to previous versions.
2026-02-18 14:03:11 +01:00
Grzegorz Michalski
204616252a
Add pRestoreGrants parameter to CREATE_EXTERNAL_TABLES_SET for grant preservation during table recreation
2026-02-18 13:27:12 +01:00
