Work Location , Expected Annual Income :
Tokyo,8.0M ～ 10.2M
About the Company :
Fintech Group
Responsibilities :
As a Senior Data Engineer, you will be responsible for leading the overall architecture design and efficiency of the data infrastructure, ensuring the quality and consistency of data.
Technical skills to combine data from various sources, knowledge and operational experience with major public clouds, skills in relevant programming languages and scripts, and basic knowledge of AI/machine learning/deep learning/Gen AI are required.
In addition, as a team leader, you are expected to have the ability to manage organizations and personnel, as well as the ability to manage projects undertaken by the team.
Role/Responsibility
● Design, construction, maintain, and optimization of data pipelines
● Construction and management of data warehouses and datalakes
● Optimization of data modeling and ETL processes
● Management of data infrastructure
● Management and improvement of data quality
● Technical lead of team members
● Development, operation, selection, evaluation, and introduction of tools for data utilization and business departments
Requirement(Mandatory Skill set)
● Technology Skills
○ Practical experience in data engineering or related fields(+ 5 years)
○ Experience in building and operating data warehouses (such as Redshift, BigQuery, Snowflake)
○ More than 5 years of development experience in Python, SQL, and other programming languages
○ Experience in development, implementation, and operation using public cloud (mainly GCP)
Skills
○ Language skills : Japanese (Native), English (Business)
○ Excellent communication skills.
○ Team management experience.
○ Be a Self-starter who takes initiative to work.
Optional (Nice to have)
● Deep knowledge and experience in SQL and NoSQL databases.
● Knowledge of DevOps and CI/CD pipelines.
● Basic knowledge of machine learning and experience in deploying and operating models.
● Development experience using Embulk or Apache Airflow.
● Experience with data visualization tools (such as Tableau, Looker, Power BI).
● Knowledge in data management.
● Experience in utilizing Google Workspace.
● Experience with data collaboration with control systems such as SCADA.
Benefits :
- Various social insurances (employee pension insurance, health insurance, employment insurance, workers' compensation insurance)
- Corporate defined contribution pension plan
- Employee stock ownership plan
Required Experience / Abilities / Skills :
○ Data engineering (+ 5 years)
○ building and operating data warehouses (Redshift, BigQuery, Snowflake)
○ + 5 years of development experience in Python, SQL
○ AWS /GCP
○ Data visualization tools: Tableau, Looker, Power BI