Position Summary: We are looking for a highly skilled Database Migration Specialist to manage the transition of databases from Sybase and MySQL to PostgreSQL and Amazon Redshift. This position will be responsible for leading all aspects of the migration process, ensuring that data integrity is maintained, and optimizing both performance and efficiency during migration. The ideal candidate will have a strong understanding of both transactional and analytical databases, with hands-on experience in large-scale database migrations.
Key Responsibilities:
-
Migration Strategy and Planning:
- Review and assess current Sybase and MySQL environments, analyzing schema, stored procedures, triggers, and dependencies.
- Develop a tailored migration approach for PostgreSQL (for transactional workloads) and Amazon Redshift (for analytics workloads).
- Plan for minimal downtime, thorough data validation, and prepare rollback strategies to address potential migration challenges.
-
Schema and Data Transition:
- Leverage tools such as AWS Schema Conversion Tool, pgLoader, Ora2Pg, and AWS Data Migration Service to automate the migration of schemas and data.
- Customize scripts for complex schema migrations, ensuring that views, triggers, and stored procedures are effectively converted.
- Execute data validation and transformation to ensure accurate and clean data during the transition.
-
Performance Enhancement:
- Tune PostgreSQL for optimal transactional performance, including indexing, partitioning, and query optimization.
- Optimize Redshift configurations, focusing on distribution keys, sort keys, and advanced compression.
- Design efficient ETL workflows for Redshift, utilizing AWS Glue, Matillion, or custom scripting solutions.
-
Testing and Quality Assurance:
- Develop and implement testing strategies for functional validation, data accuracy, and performance benchmarking.
- Ensure that all data between the original and target systems is verified for integrity.
- Address performance bottlenecks and ensure that all associated applications and reporting systems function seamlessly post-migration.
-
Post-Migration Support & Documentation:
- Provide continued support after migration, focusing on tuning database performance and resolving any issues.
- Document the migration process, configurations, troubleshooting steps, and best practices for future reference.
- Guide teams in leveraging PostgreSQL and Redshift effectively, including query optimization and ongoing database maintenance.
Required Skills & Qualifications:
Technical Proficiency:
- Extensive expertise in Sybase, MySQL, PostgreSQL, and Amazon Redshift environments.
- Skilled in using migration tools such as AWS Schema Conversion Tool, pgLoader, Ora2Pg, and AWS Data Migration Service.
- Strong scripting abilities (e.g., Python, Bash, Perl) for custom migration and automation tasks.
- In-depth knowledge of PostgreSQL-specific features like PL/pgSQL, partitioning, and JSON.
- Hands-on experience with Redshift performance optimization, including query tuning, distribution styles, and sort keys.
- Familiarity with data integration tools like AWS Glue, Apache Airflow, and Talend.
Experience:
- Over 7 years of experience in database administration or migration.
- Proven expertise in migrating databases from Sybase and MySQL to PostgreSQL and/or Redshift.
- Experience with large-scale migration projects involving OLTP and OLAP systems.
Soft Skills:
- Strong problem-solving and analytical mindset for troubleshooting migration and performance issues.
- Exceptional communication skills, with the ability to collaborate effectively across teams.
- Project management experience, with the ability to meet deadlines in fast-paced environments.
Preferred Qualifications:
- AWS certifications, such as AWS Certified Solutions Architect or AWS Certified Data Analytics.
- Familiarity with real-time data replication and Change Data Capture (CDC) tools like Kafka or Debezium.
- Knowledge of AWS cloud infrastructure, including services like EC2, S3, and IAM.
- Experience with containerized environments (Docker, Kubernetes) for deployment and testing.
This role offers an exciting opportunity to work with advanced technologies and lead a critical migration initiative in a dynamic, fast-paced environment.