Building Search Engine Data Pipeline

Oct. 30, 2016, noon - 12:25 p.m.

This talk is about the experiences that we have gained during the development of our Building Radar search engine. In detail, we will be talking about our architecture, the frameworks we use and the components of our system, like crawlers, parsers, front-end and especially we will be focusing on the data pipeline. The general approach will be the mistakes, the lessons learned and the solutions. 

This talk is NOT about search, searching algorithms, page rankings and so on…

Güven Candogan

Pipeline Lead Engineer

Get our Python announcements