Desenvolvedor(a) Full Stack - SR

Аналитика рынка

Стек

Бесплатно. Вход по почте.

Откликнуться

Загрузите резюме — мы свяжем вас с работодателем напрямую через нашу базу.

Описание

Accountabilities: - ETL pipeline development and optimization Evolve and optimize ETL pipelines, improving the performance of filtering, joins, deduplication, aggregation, and other data transformation operations. - Optimize the reading and writing of large files, including CSV, Parquet, and Gzip formats. - Ensure data processing workflows remain stable, efficient, and scalable as data volumes increase. - Explore and implement suitable approaches for handling large-scale datasets and improving processing performance. - Backend development and database management Develop and maintain backend services using Python and FastAPI, supporting data reconciliation and related platform functionality. - Design, manage, and optimize PostgreSQL persistence, including schemas, indexes, queries, and metadata structures. - Maintain database records for jobs, manifests, processing history, and configuration parameters. - Apply database performance optimization techniques, including query analysis and execution-plan evaluation, to improve data access and processing efficiency. - Implement caching, server-side pagination, and sorting mechanisms to support efficient interaction with large datasets. - Cloud infrastructure and data storage Integrate and manage file storage and processing results using Amazon Web Services (AWS), particularly Amazon S3. - Work with AWS Athena and Amazon EKS to support data querying and application deployment or operations. - Contribute to the reliability, scalabilit

Полное описание, компания и ссылка на вакансию — после входа. Войти

Контакты работодателя (email/phone/telegram) скрыты из публичного превью — отправьте резюме, чтобы мы связали вас напрямую.