Grzegorz Michalski
2605896469
refactor(EXPORT): Improve formatting and logging
2026-02-24 08:22:42 +01:00
Grzegorz Michalski
e538706896
feat(MARS-826): Add pTemplateTableName parameter to export scripts for various tables
2026-02-20 15:16:37 +01:00
Grzegorz Michalski
866b886c70
Merge develop into main - added pJobClass parameter and MARS-826, MARS-835, MARS-828 updates
2026-02-20 10:09:37 +01:00
Grzegorz Michalski
3848a9471b
Add pJobClass parameter to export scripts for Oracle Scheduler resource management
2026-02-19 11:26:51 +01:00
Grzegorz Michalski
2143a81aa0
Add pJobClass parameter to MARS-835 export scripts for Oracle Scheduler resource management
2026-02-18 12:58:18 +01:00
Grzegorz Michalski
b6cf54f103
Add JOB_CLASS parameter to DATA_EXPORTER for Oracle Scheduler support
2026-02-18 12:58:06 +01:00
Grzegorz Michalski
6ade77c3c0
Update DATA_EXPORTER package to version 2.10.1, fixing redundant deletion of COMPLETED chunks before parallel export to prevent ORA-01403 errors.
2026-02-17 12:03:36 +01:00
Grzegorz Michalski
8ce07c3360
Add grant and rollback scripts for EXECUTE privilege on T_FILENAME to MRDS_LOADER
2026-02-17 12:03:21 +01:00
Grzegorz Michalski
64dc830a2b
Add 'VALIDATION_FAILED' status to A_SOURCE_FILE_RECEIVED constraint for improved status handling
2026-02-17 11:54:07 +01:00
Grzegorz Michalski
020dacb571
Refactor MARS-835 installation scripts to include explicit date handling and remove obsolete files
2026-02-17 11:12:03 +01:00
Grzegorz Michalski
057a4e7ce3
Enhance trigger validation in MARS-828 verification script to improve error handling and output clarity
2026-02-16 11:01:44 +01:00
Grzegorz Michalski
a9a51f19be
Rename ARCH_FILE_NAME to ARCH_PATH in FILE_ARCHIVER for clarity and consistency in directory URI handling
2026-02-16 11:01:01 +01:00
Grzegorz Michalski
b6f6446232
Add author information to MARS-828 installation script
2026-02-13 21:05:09 +01:00
Grzegorz Michalski
aa2f2f13f9
Update author information to Grzegorz Michalski in MARS-835 SQL scripts
2026-02-13 20:16:05 +01:00
Grzegorz Michalski
d370b9c9ef
Update DATA_EXPORTER package to version 2.10.0 with multi-file support for DBMS_CLOUD.EXPORT_DATA, preventing orphaned files in rollback processes.
2026-02-13 19:08:54 +01:00
Grzegorz Michalski
c5d39fc01d
Add ENV_MANAGER package with comprehensive error handling and logging features
...
- Introduced ENV_MANAGER package for managing environment configurations and error handling.
- Implemented detailed error codes and messages for various scenarios, enhancing debugging capabilities.
- Added logging procedures to track process events and errors, with configurable logging levels.
- Included version management functions to track package versioning and changes.
- Established a structure for documenting functions and procedures for better maintainability.
2026-02-13 13:56:36 +01:00
Grzegorz Michalski
a4ab56e96d
Enhance MARS-835 rollback process with new scripts for file registration deletion and manual cleanup, and add process tracking identifier for exports
2026-02-13 12:36:45 +01:00
Grzegorz Michalski
92c5261215
Revert "Add process tracking identifier to MARS-835 export and rollback scripts"
...
This reverts commit 2c40f091e0 .
2026-02-13 09:45:49 +01:00
Grzegorz Michalski
b34c942a8f
Revert "Enhance MARS-826 Rollback Scripts and Export Procedures"
...
This reverts commit d6c34085f7 .
2026-02-13 09:24:02 +01:00
Grzegorz Michalski
d175179ddc
Update DATA_EXPORTER package version to 2.9.0 and enhance version history for process tracking improvements
2026-02-13 09:21:06 +01:00
Grzegorz Michalski
d8a5edc3b1
Update step prompts for MARS-835-PREHOOK installation script to reflect correct sequence of operations
2026-02-13 09:00:42 +01:00
Grzegorz Michalski
d6c34085f7
Enhance MARS-826 Rollback Scripts and Export Procedures
...
- Added parameters `pRegisterExport` and `pProcessName` to export procedures for better tracking.
- Created a new rollback script `90_MARS_826_rollback_file_registrations.sql` to delete file registration records from `A_SOURCE_FILE_RECEIVED`.
- Updated existing rollback scripts for ADHOC_ADJ, BALANCESHEET, CSM_ADJ, STANDING_FACILITY, MRR_IND_CURRENT_ACCOUNT, FORECAST, QR_ADJ, and TTS tables to improve file deletion logic and output messages.
- Ensured all rollback scripts provide informative output regarding the number of files deleted or skipped.
2026-02-13 09:00:13 +01:00
Grzegorz Michalski
2c40f091e0
Add process tracking identifier to MARS-835 export and rollback scripts
2026-02-13 08:50:56 +01:00
Grzegorz Michalski
0053ecc556
Add MARS-835-PREHOOK scripts to update and rollback A_SOURCE_FILE_RECEIVED table structure
2026-02-13 08:39:03 +01:00
Grzegorz Michalski
a3ec31341b
Update DATA_EXPORTER package to version 2.8.1, fix query in EXPORT_TABLE_DATA to ensure single file output, and update version history.
2026-02-12 16:31:00 +01:00
Grzegorz Michalski
6039d6bce4
Update DATA_EXPORTER package to version 2.8.0, refactor EXPORT_TABLE_DATA to export to a single CSV file, and add pFileName and pMaxFileSize parameters.
2026-02-12 09:56:57 +01:00
Grzegorz Michalski
15dafbff2a
zachowanie wersj 2.7.5
2026-02-12 09:27:57 +01:00
Grzegorz Michalski
1327410880
Fix URI construction in ARCHIVE_TABLE_DATA procedure to include 'ARCHIVE' directory for correct file path.
2026-02-11 21:53:31 +01:00
Grzegorz Michalski
f4e9fb9cb2
Merge branch 'develop'
2026-02-11 21:32:47 +01:00
Grzegorz Michalski
641af7415f
Update DATA_EXPORTER package to version 2.7.5, adding pRegisterExport parameter to EXPORT_TABLE_DATA procedure for file registration in A_SOURCE_FILE_RECEIVED.
2026-02-11 20:32:21 +01:00
Grzegorz Michalski
63ed05930e
Enhance EXPORT_TABLE_DATA procedure by adding pTemplateTableName parameter for flexible column order and date formatting. Update version history for clarity on recent changes.
2026-02-11 19:46:28 +01:00
Grzegorz Michalski
5320db627b
przygotowanie pod nowe zmiany
2026-02-11 19:04:06 +01:00
Grzegorz Michalski
3171ff2ddf
Update DATA_EXPORTER package to version 2.7.4, enhancing filename storage and metadata retrieval logic for exported files.
2026-02-11 18:27:44 +01:00
Grzegorz Michalski
26aba08759
Add FILE_ARCHIVER package and enhance A_SOURCE_FILE_CONFIG table
...
- Created new FILE_ARCHIVER package (v3.2.1) for managing file archival processes, including procedures for archiving, restoring, and purging files.
- Added versioning and build information to the package with detailed version history.
- Enhanced A_SOURCE_FILE_CONFIG table by adding ARCHIVE_ENABLED and KEEP_IN_TRASH columns to control archival participation and TRASH retention policy.
- Implemented constraints and comments for new columns to ensure data integrity and provide clarity on their usage.
2026-02-11 18:24:18 +01:00
Grzegorz Michalski
d237c2d7aa
pRegisterExport
2026-02-11 09:54:04 +01:00
Grzegorz Michalski
96e3e2f845
pRegisterExport
2026-02-11 09:53:53 +01:00
Grzegorz Michalski
3eb39091de
dodanie: pRegisterExport => TRUE
2026-02-11 09:49:28 +01:00
Grzegorz Michalski
113b9f55e3
deprecated version 2.8.0
2026-02-11 09:45:11 +01:00
Grzegorz Michalski
b96becd8ef
Add autonomous transaction pragma to ARCHIVE_TABLE_DATA and GATHER_TABLE_STAT procedures for improved transaction handling
2026-02-11 07:36:52 +01:00
Grzegorz Michalski
b1bb24e487
Refactor file retrieval logic in ARCHIVE_TABLE_DATA and GATHER_TABLE_STAT procedures to simplify queries and enhance clarity
2026-02-10 14:03:52 +01:00
Grzegorz Michalski
86535048fc
Add TRASH folder management procedures for restoring and purging files
2026-02-10 13:53:12 +01:00
Grzegorz Michalski
9ffad718fe
Update FILE_ARCHIVER package to version 3.2.1, fixing status update from ARCHIVED to ARCHIVED_AND_TRASHED for files moved to TRASH folder
2026-02-10 13:18:17 +01:00
Grzegorz Michalski
6c8b22eac9
Add DATA_EXPORTER package and update installation scripts for export registration
...
- Created new package CT_MRDS.DATA_EXPORTER (v2.6.3) for comprehensive data export capabilities, including CSV and Parquet formats with OCI integration.
- Implemented version history tracking and enhanced error handling for export processes.
- Updated installation scripts to include pRegisterExport parameter for registering exports in A_WORKFLOW_HISTORY and A_SOURCE_FILE_RECEIVED.
2026-02-10 09:33:46 +01:00
Grzegorz Michalski
d443c4f07d
Update FILE_ARCHIVER package to version 3.2.0 with TRASH retention control and new statuses
2026-02-10 08:23:06 +01:00
Grzegorz Michalski
70909ba8c4
Enhance FILE_ARCHIVER package to include ODS bucket URI retrieval and update insert statements for A_TABLE_STAT_HIST and A_TABLE_STAT
2026-02-09 13:42:50 +01:00
Grzegorz Michalski
88325f0b8c
Refactor FILE_ARCHIVER package to use CT_MRDS.ENV_MANAGER consistently for logging and parameter formatting
2026-02-09 11:04:33 +01:00
Grzegorz Michalski
dc8031262c
konfiguracja
2026-02-09 10:22:38 +01:00
Grzegorz Michalski
fc95b12c9e
Remove test scenarios for archival strategies from test_archival_strategies.sql
2026-02-09 09:40:31 +01:00
Grzegorz Michalski
23b9962128
Update ARCHIVE_TABLE_DATA procedure to use GROUP BY instead of DISTINCT to resolve ORA-22950 issue
2026-02-09 09:36:05 +01:00
Grzegorz Michalski
802c102f29
Refactor archival strategy logic in FILE_ARCHIVER package to enhance clarity and support for age-based archiving
2026-02-09 09:12:49 +01:00