Python AI Agent to Generate Application specific Web Scraping rules.

We are looking for an experienced Python AI Agent Developer to build an AI-powered application that automatically generates application-specific web scraping rules. The objective is to develop an AI agent that can analyze a target web application, understand its structure and behavior, identify relevant data elements, and generate structured scraping rules that can be used by our existing web scraping engine. The solution should reduce the manual effort required to create and maintain scraping rules for different applications. Develop a Python-based AI agent for automated web scraping rule generation. Analyze application-specific web pages, HTML DOM structures, and browser interactions. Identify relevant data elements, labels, fields, buttons, tables, and other UI components. Generate structured scraping rules for extracting application-specific data. Use LLMs and AI reasoning to understand application structure and map UI elements to business data. Handle dynamic web pages, JavaScript-rendered content, and complex UI structures. Generate rules in a structured JSON format. Validate generated rules against the target application and verify extraction accuracy. Implement error handling, retry mechanisms, and rule correction capabilities. Design the solution to support multiple applications and reusable rule-generation components.