Desenvolvedor(a) Full Stack - SR

Market insights

Stack

Apply

Upload your CV — we will connect you with the employer directly through our pool.

Description

Accountabilities: - ETL pipeline development and optimization Evolve and optimize ETL pipelines, improving the performance of filtering, joins, deduplication, aggregation, and other data transformation operations. - Optimize the reading and writing of large files, including CSV, Parquet, and Gzip formats. - Ensure data processing workflows remain stable, efficient, and scalable as data volumes increase. - Explore and implement suitable approaches for handling large-scale datasets and improving processing performance. - Backend development and database management Develop and maintain backend services using Python and FastAPI, supporting data reconciliation and related platform functionality. - Design, manage, and optimize PostgreSQL persistence, including schemas, indexes, queries, and metadata structures. - Maintain database records for jobs, manifests, processing history, and configuration parameters. - Apply database performance optimization techniques, including query analysis and execution-plan evaluation, to improve data access and processing efficiency. - Implement caching, server-side pagination, and sorting mechanisms to support efficient interaction with large datasets. - Cloud infrastructure and data storage Integrate and manage file storage and processing results using Amazon Web Services (AWS), particularly Amazon S3. - Work with AWS Athena and Amazon EKS to support data querying and application deployment or operations. - Contribute to the reliability, scalabilit

Employer contacts (email/phone/telegram) are hidden from the public preview — send your CV, and we will connect you directly.