Case study
Company details
Offices:
USA, Poland
Company size:
60-200 employees (medium)
Industry:
Martech (SaaS tool)
Revenue:
$25M+ ARR
credits sold in 6mo
LLM tokens daily
NO TIME TO WASTE
Surfer approached us to share our experience and expertise on the possibilities of current generative technology. Our first task was to find and approach R&D process that would lead to a final product.
Early consultations and defining the scope given the current and predicted state of technology.
We provided a 1-month PoC of what’s possible with current technologies. We used rapid prototyping technologies like Gradio, GPT, OpenAI Embeddings, LangChain, etc. - based on the data provided by Surfer. The client was happy with the results and decided to launch a large-scale project.
We build a production-ready solution, based on LLM models. Our ML team together with Surfer's frontend and backend specialists focused on creating a release version of the product. A well-evaluated pipeline of more than 30 distinctive ML tasks was created with 3 major technological breakthroughs in NLP released during development. About a week before the planned release, OpenAI released a game-changing GPT4-32k model that we managed to integrate & evaluate to the final solution before launch. Thanks to us, Surfer was the first company in the SEO market with this kind of technology inside.
We were constantly conducting assessments and improving the pipeline adjustments. After release, our team focused on evaluating user and internal feedback. Thanks to that we were super up-to-date and we were able to improve the ML solutions weekly. The AI’s satisfaction score has DOUBLED since launch, and we introduced new features like providing custom knowledge, writing points, product reviews, comparison templates & many more.
Providing the highest quality fact-checked informative content
Our goal was to create content that's not only seo-optimized, but that provides well-researched information for the reader. We had to create over 30-step knowledge gathering and fact-checking pipeline to be sure, that the content we created matches or exceeds the quality of human writers.
Constantly changing SOTA Technology
During development, about every 3 months there was a real breakthrough in terms of state-of-the-art generative models. Surfer put heavy emphasis on being the best in the field and our team was constantly evaluating and improving based on the latest foundational models
Continuous evaluations
We had to merge challenging evaluations, such as comparing the "quality" of writing, with rapid development cycles. We designed an evaluation process that integrates efficient module-based internal testing using LabelStudio with internal SEO specialists, and production A/B testing complemented by user feedback comparison. This approach allows us to release new pipelines every 1 to 2 weeks.
Shipping bleeding-edge technology with high reliability
We successfully addressed the instability issues that are inherent for LLMs. We designed a robust architecture that ensures fail-proof operation with more than 30 interdependent modules, achieving a level of stability that is ready for production use.
Let's check out what SurferSEO has to say about us.