Join to apply for the Senior Data Engineer role at HKT4 days ago Be among the first 25 applicants Join to apply for the Senior Data Engineer role at HKTGet AI-powered advice on this job and more exclusive features. Responsible for designing, developing, and maintaining the data infrastructure and systems required for efficient and reliable data processing. They work closely with data scientists, analysts, and other stakeholders to understand their requirements and translate them into scalable and robust solutions. Key Responsibilities: Designing and implementing scalable data pipelines to collect, process, transform, and store large volumes of structured and unstructured data. Developing efficient ETL (Extract, Transform, Load) processes to ensure the availability of clean and accurate data for analysis. Building and maintaining data warehouses or data lakes to enable easy access to structured datasets for reporting and analytics purposes. Collaborating with cross-functional teams to identify opportunities for improving data quality, reliability, performance, and efficiency. Implementing appropriate security measures to protect sensitive data from unauthorized access or breaches. Monitoring system performance, identifying bottlenecks or issues, and implementing optimizations to ensure high availability and scalability. Conducting thorough testing of developed solutions to ensure they meet functional requirements and performance expectations. Mentoring junior team members by providing guidance on best practices in software development, database design, and data engineering techniques. Staying up-to-date with emerging technologies in the field of big data processing, cloud computing, distributed systems, etc., and evaluating their potential applications in the organization's context. Collaborating with stakeholders to understand their business needs and translating them into technical requirements. Requirements: Bachelor's or Master's degree in Computer Science, Engineering or a related field. Proven experience as a Data Engineer or similar role with a focus on building scalable data processing systems. Strong programming skills in languages like Python/Java/Scala along with proficiency in SQL for querying databases. Experience working with big data technologies such as Hadoop ecosystem (HDFS, Map Reduce), Apache Spark/Py Spark for distributed computing. Proficiency in working with relational databases (e.g., My SQL) as well as No SQL databases (e.g., Mongo DB). Familiarity with cloud platforms like GCP/AWS/Azure for deploying scalable infrastructure using services like S3, EC2 instances etc. Knowledge of containerization technologies like Docker/Kubernetes is desirable but not mandatory. Strong problem-solving skills with an ability to analyze complex datasets efficiently. Excellent communication skills to effectively collaborate with cross-functional teams. Candidate should have a strong understanding of data platforms, including architecture, components, and functionalities. Candidate should be proficient in data integration, storage, processing, analytics, and visualization technologies. Knowledge of programming languages like SQL, Python, or R is also beneficial. A senior data engineer plays a crucial role in ensuring the availability of high-quality data that drives informed decision-making within an organization. They contribute significantly towards building a robust foundation for advanced analytics initiatives by leveraging their expertise in designing scalable systems capable of handling large volumes of diverse datasets efficiently while ensuring security and reliability throughout the process Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function Job function Information Technology Industries Telecommunications Referrals increase your chances of interviewing at HKT by 2x Get notified about new Senior Data Engineer jobs in Hong Kong, Hong Kong SAR. Consultant/ Senior Consultant (Data Engineer) - AI & Data - Hong Kong(314333)Senior Systems Analyst / Systems Analyst (Data Section)Senior Consultant, Data Engineer, Finance Consulting Senior Consultant / Manager, Data Engineer, Transformation (FC)Senior Associate, Data Analyst (Sales Management and RM Analytics)Data and Artificial Intelligence Architect Shenzhen, Guangdong, China CN¥25,000.00-CN¥35,000.00 1 year ago Senior Data & Reporting Analyst( Consider Fresh Graduates For Junior Position)Shenzhen, Guangdong, China CN¥18,000.00-CN¥36,000.00 2 years ago Shenzhen, Guangdong, China CN¥20,000.00-CN¥25,000.00 1 year ago ANALYST PROGRAMMER / SENIOR PROGRAMMER / PROGRAMMERSenior Data Analyst / Assistant Data Marketing Manager (subject to experience)Data Architect (ETL/Azure Cloud) ~Up to 68 KSenior Software Engineer - Group Chief Information Officer Data Engineer - Anti Financial Crime (Business Analysis Manager)(Senior) Software Engineer, OTT Streaming Support Senior Consultant / Manager, Software Engineer, Transformation, Finance Consulting Shenzhen, Guangdong, China CN¥27,000.00-CN¥40,000.00 1 year ago Senior Manager, Asia Operations Data Analyst Insurance Data Science / Machine Learning / Data Analytics / Data Architect / Data Engineering / Data Governance (Junior to Senior Level)We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr