IT関連（オープン・WEB系） - データベースSE
IT関連（オープン・WEB系） - プログラマー
IT関連（組込み/制御系） - ソフトウェア設計
Ahead Group is looking for a Data Engineer to join our client’s Architecture team within IT Solution Delivery department and build topnotch data solutions and applications that power crucial business decisions throughout the organization.
The client is looking for an open-minded, structured thinker who is passionate about building systems at scale. You’ll be the mastermind behind our evolving consolidated data hub, which includes master data repositories, data replication area, data quality and security modules. You will be the one who knows where to find all the data and manage the process to make it useful for analytics and other external services.
You will be responsible for modelling and implementing data hub itself, as well as designing, building, and optimizing data pipelines to ensure the quality of data flowing into it. This role must be comfortable interfacing and supporting multiple teams and working with business managers, application developers, data architects, data scientists, business analysts, and project managers, at local, regional and global levels. The ideal candidate has a passion for data, significant experience building production level data pipelines, enjoys working in a selfdirected environment. Incumbents of this position will regularly exercise discretionary and substantial decision-making authority.
You will be consulted on the information architecture of any upcoming project and help design the event collection infrastructure, build the data models, ETL/ESB processes and services to provide this data for business use. You will be working with large datasets, reporting platforms and data visualization. You'll own a problem end-to-end, so those skills will come in handy not just to collect, extract, and clean the data, but also to understand the systems that generated it, and automate analyses and reporting. On an on-going basis, you'll be responsible for improving the data by adding new sources, new repositories, coding business rules and producing new metrics that support the business. You are expected to be motivated by solving challenging problems, where creativity is as crucial as the ability to design and write code.
Roles and responsibilities
Manage detailed design of data hub architecture, including data model and OTS components.
Design and implement configurable, parametrized, scalable, robust data pipelines to ingest volumes of application data into data hub, using ETL/ESB/APIs/scraping.
Architect and implement customer facing analytics and reporting services.
Design and build mircoservice architecture around data hub.
Develop fuzzy search mechanisms based on Elasticsearch or other best-fit string search solutions capable of processing Japanese characters.
Mentor other engineers in the fundamentals of data engineering and data science.
Evaluate technology stacks, including data storage, databases, data quality and MDM.
Carry out database maintenance and performance tuning; query optimizations.
Write technical documentation (architecture, software design, knowledge base, explanatory material, RFI/RFP).
Implement best practices, i.e., using code repositories, documenting procedures, refactoring code to be more robust and modularized.
Perform data exploration and visualization with Tableau; pass on necessary knowledge to data scientists and analysts.
Use Python or any other data parsing technology to clean data, extract features and build models.
Required Skills and Experiences:
5-10 years professional experience as a data engineer or in a similar role.
5+ years of experience with data modeling, ETL (e.g. Informatica) and data warehousing.
3+ years of hands-on experience in writing complex, highly-optimized SQL queries across large data sets.
Advanced knowledge of Oracle database with supported certification.
2+ years of experience in scripting languages like Python.
2+ years of experience designing and building Web API/microservices.
Experience with MDM (Informatica, Tibco).
Experience working with business intelligence tools such as Tableau or equivalent.
Ability to meet tight deadlines and prioritize workloads in a fast paced environment.
Strong programming skills (some combination of Java and Python or similar preferred).
Experience working with MongoDB or other No-SQL databases would be a plus.
Understanding of data modeling and distributed computing/data principles and technologies (Hadoop, Cassandra).
Strong understanding of the challenges of designing and maintaining scalable big data platforms.
Exposure to data science fundamentals and familiarity with tools/languages like R.
Hands-on experience with CI/CD (Git, SVN, Jenkins) and automated testing.
Bachelor’s or Master's degree in Computer Science, Information Systems, Engineering or related field
Fluent English and business-level Japanese for communication with internal IT and nonIT teams, external development partners and 3-rd party solution providers.
Expected soft-skill profile
Ability to lead development process, drive architectural decisions, incorporate business and technology strategy.
Ability to deal with vague requirements, rapid iterations; be nimble and take smart risks.
Ability to educate others with persuasion and passion.
Credibility and confidence when presenting and communicating.
Willingness to challenge the status quo, suggest new approaches to old problems, promote continuous improvement and creativity.
Result-driven, eager to own activities and be responsible.
Enthusiastic and never-tiring learner.
|英語能力||ビジネス会話 (TOEIC 735-860)|
|年収||日本・円 1000万円 〜 1200万円|