Company Overview: 1840 & Company is a global business process outsourcing provider that connects companies with vetted, remote talent across various disciplines. We are dedicated to revolutionizing how companies hire, manage, and grow their workforce in today's dynamic global job market. With our vast network of pre-vetted talent in over 150 countries, we offer solutions that significantly reduce hiring costs and enhance workforce flexibility and efficiency.

Job Summary: We are seeking an experienced AI Developer to create advanced AI search applications for our diverse range of clients. The ideal candidate will possess a strong background in web crawling and scraping, as well as in developing AI-driven search functionalities for various purposes. This should include specific experience with keyword and semantic searches (both hybrid sparse and dense techniques) and vector databases like Pinecone. Additionally, a solid track record in automating crawling and scraping of large amounts of website data, using tools such as Apify's web crawler, is essential. The role entails extensive web data crawling and scraping, processing and vectorizing this data, and then upserting it into a vector database like Pinecone to create sophisticated AI search functionality. This functionality will then be integrated into APIs for use by front-end developers.

Key Responsibilities:
  • Design and develop advanced AI search functionality using Pinecone for vector storage and OpenAI for enhanced keyword search generation.
  • Automate the process of crawling and scraping web content, ensuring efficient and accurate data collection.
  • Design and implement secure data management protocols to ensure all collected data is saved directly to company-controlled systems, avoiding local storage to maintain data security and availability.
  • Pre-process scraped data to ensure its relevance and readiness for analysis and storage.
  • Vectorize content into embeddings using advanced models such as text-embedding-3-small or ADA v2, ensuring optimal search performance and accuracy.
  • Manage the upserting pipeline to store vectorized content into Pinecone, ensuring seamless data integration and retrieval.
  • Develop and maintain APIs using AWS services, including Lambda for scalability and API Gateway for API management.
  • Work closely with the development team (ReactJS/WordPress) to integrate the AI search functionality onto the front end of website.
  • Utilize FastAPI for developing robust search logic APIs and ensure smooth frontend integration.
  • Collaborate with cross-functional teams to define project scope, plan resources, and ensure timely delivery of projects.
  • Conduct thorough testing and gather feedback to refine and optimize the search tool.
  • Stay abreast of the latest AI and machine learning technologies and methodologies to drive continuous innovation.
  • Exhibit strong self-management skills, capable of independently driving projects forward and delivering results promptly and effectively.
Qualifications:
  • Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, or related field.
  • Expertise in automating web crawling and scraping, with a deep understanding of circumventing blockers to ensure reliable data collection. Proven ability to optimize processes to reduce the costs associated with crawling and scraping.
  • Proven experience in developing AI-driven search tools, with at least 2+ years of experience working with vector databases, specifically Pinecone.
  • In-depth knowledge of OpenAI GPT-3, including experience with generating keywords and enhancing search functionalities.
  • Strong proficiency in AWS services (Lambda, API Gateway, DynamoDB) and experience with deploying Dockerized applications using AWS Lambda.
  • Experience with FastAPI or similar frameworks for API development.
  • Familiarity with front-end integration and ensuring seamless user experiences.
  • Excellent problem-solving abilities, with a keen attention to detail and a commitment to high-quality output.
  • Strong communication skills and the ability to work collaboratively in a fast-paced, dynamic environment.

Benefits

  • Work from home
  • Access to diverse projects
  • Opportunities for professional growth
  • Collaboration with diverse teams
  • No commute time
  • No dress code (unless there’s a meeting!)
  • Eco-friendly work lifestyle
  • Exposure to a multicultural team
  • Potential for long-term engagement
  • Improved work-life balance

About 1840 & Company

1840 & Company is a global leader in Business Process Outsourcing (BPO) and remote talent solutions, dedicated to propelling businesses forward through our comprehensive suite of services. We specialize in connecting companies with world-class freelance professionals and delivering top-tier outsourcing services, across over 150 countries worldwide.

Our mission is to empower growth for forward-thinking businesses, seamlessly bridging any skill or resource gaps with our expertly vetted talent pool. We firmly believe in fostering an environment where exceptional individuals can achieve an optimal work-life balance, working remotely from any location, while maximizing their professional growth and earning potential.

We are headquartered in Overland Park, KS, USA with service delivery facilities in the Philippines, India, Ukraine, South Africa and Argentina. We invite you to explore the opportunities we offer and consider joining our exclusive network of global freelance talent. Visit www.1840andco.com to learn more about us. To explore a wealth of career opportunities and find a role that suits your unique skills and aspirations, please visit our dedicated jobs portal at jobs.1840andco.com

Salary

$10,000 - $14,000

Yearly based

Location

Nigeria - Remote

Remote Job

Job Overview
Job Posted:
5 months ago
Job Expires:
Job Type
Full Time

Share This Job: