Do you want to help make Bing the best search engine in the world? Do you imagine how the best of Web data and best of Office can power digital work/life experiences? Do you think about a future when all Microsoft teams can easily access petabytes of richly annotated web content? Would you like to design and develop new components that solve complex large scale distributed system problems? If the answer to these questions is yes, then the Bing Web Index pipeline team would like to hear from you! We’re responsible for the heart of the Bing’s web and knowledge engine. Our bold & long-term vision is to be provide Bing users and Microsoft teams the biggest, cleanest and freshest web index.
We are looking for solid engineers who can design the next gen platform pieces as well go deep in implementation. We are also looking to hire senior engineers who love to tackle deep technical challenges and strive for customer impact. We look at senior engineers to become experts and tech lead projects with engineers working with them to deliver business value. We are currently building an entire new system for web search indexing backend that will be orders of magnitude larger and faster than anything that currently exists. The new indexing pipeline is built on top of a petabyte scale table and incremental processing infrastructure. The goal of the system is to process billions of documents a day with seconds to minutes E2E latency. To design the new system, we are applying a combination of approaches from the fields of distributed computing, network programming, algorithm optimization, and machine learning. Come to define, design and deliver the next state of the art indexing pipeline.
Our core set of engineering challenges include:
Index 100s of billions of documents in a fast and efficient way.
Build a Document Understanding platform that partner teams can use to plugin to run their classifiers, models and allow friction free experimentation.
Provide Web Graph / Index as a service for Microsoft teams utilize and build rich applications.
Parsing and classifying billions of web documents and do encoding & language detection, script segmentation and sentence breaking.
Use NLP techniques to extract Named entities entity linking, POS tagging, stemming etc.
We write software from the ground-up, running across thousands of servers and managing petabytes of data. Problems our group addresses daily range from designing new infrastructure pieces that lets us scale to handle petabytes of data processing; NLP algorithms to extract features out web documents; Debugging tools for customer feedback on why a particular page does not have the right data in the index.
The successful candidate must have:
-Strong C/C++/C#/Java skills with at least 1+ years of programming experience and a CS degree or equivalent
-Strong design skills and engineering excellence fundamentals
-A solid understanding of low level hardware/OS fundamentals
-Experience in writing efficient multi-threaded code
-Passion for delivering high quality software on a rapid ship cycle
Candidates would find the following experiences advantageous:
- Developing machine-learning based solutions
- Optimizing complex systems
-Working on distributed infrastructure
-Shipping service based applications
-Acted as tech leads or project leads
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to email@example.com.
A little about us:
Microsoft offers training and employment opportunities to help you turn your military experience and skills into a civilian technology career.