o ưi@sdZddlmZmZmZmZmZddlZddlm Z ddl m Z m Z mZddlmZGdddeZGd d d ed d ZGd dde ZdS)z Calls Firecrawl's /search endpoint to search the web. Firecrawl API Reference: https://docs.firecrawl.dev/api-reference/endpoint/search )DictListOptional TypedDictUnionN)Logging)BaseSearchConfigSearchResponse SearchResult)get_secret_strc@seZdZUdZeed<dS)_FirecrawlSearchRequestRequiredz1Required fields for Firecrawl Search API request.queryN)__name__ __module__ __qualname____doc__str__annotations__rrc/home/app/Keep/.python/lib/python3.10/site-packages/litellm/llms/firecrawl/search/transformation.pyr s  r c@sjeZdZUdZeed<eeed<eeeefed<eed<eed<eed<eed<e ed <eed <d S) FirecrawlSearchRequestzu Firecrawl Search API request format. Based on: https://docs.firecrawl.dev/api-reference/endpoint/search limitsources categoriesZtbslocationcountrytimeoutZignoreInvalidURLs scrapeOptionsN) rrrrintrrrrboolrrrrrs   rF)totalc @seZdZdZedefddZ  ddedeedeedefd d Z ddeed e d ee ee efdefd dZ de ee efd e defddZdejdedefddZdS)FirecrawlSearchConfigzhttps://api.firecrawl.dev/v2returncCsdS)NZ Firecrawlrrrrrui_friendly_name+sz&FirecrawlSearchConfig.ui_friendly_nameNheadersapi_keyapi_basecKs2|ptd}|s tdd||d<d|d<|S)z: Validate environment and return headers. ZFIRECRAWL_API_KEYzKFIRECRAWL_API_KEY is not set. Set `FIRECRAWL_API_KEY` environment variable.zBearer Authorizationzapplication/jsonz Content-Type)r ValueError)selfr$r%r&kwargsrrrvalidate_environment/s z*FirecrawlSearchConfig.validate_environmentoptional_paramsdatacKs*|ptdp|j}|ds|d}|S)z7 Get complete URL for Search endpoint. FIRECRAWL_API_BASEz/search)r r.endswith)r)r&r,r-r*rrrget_complete_url@s  z&FirecrawlSearchConfig.get_complete_urlr cKst|tr d|}d|i}d|vr|d|d<d|vr"|d|d<t|}|D]\}}||vr<||vr<|||<q*d|vrIdgdd |d<|S) u Transform Search request to Firecrawl API format. Transforms Perplexity unified spec parameters: - query → query (same) - max_results → limit - search_domain_filter → (not directly supported, can use scrapeOptions) - country → country - max_tokens_per_page → (not applicable, ignored) All other Firecrawl-specific parameters are passed through as-is. Args: query: Search query (string or list of strings). Firecrawl only supports single string queries. optional_params: Optional parameters for the request Returns: Dict with typed request data following FirecrawlSearchRequest spec  r Z max_resultsrrrmarkdownT)formatsZonlyMainContent) isinstancelistjoindictitemsZ(get_supported_perplexity_optional_params)r)r r,r*Z request_dataZ result_dataparamvaluerrrtransform_search_requestSs$     z.FirecrawlSearchConfig.transform_search_request raw_response logging_objc Ks|}g}|di}|dg}|D]#}|dp |dd} t|dd|dd| ddd } || q|d g} | D]&}|dpL|d d} t|dd|dd| |d dd } || q@t|d dS)u4 Transform Firecrawl API response to LiteLLM unified SearchResponse format. Firecrawl → LiteLLM mappings: - data.web[].title → SearchResult.title - data.web[].url → SearchResult.url - data.web[].description OR data.web[].markdown → SearchResult.snippet - No date field in web results (set to None) - No last_updated field in Firecrawl response (set to None) Note: Firecrawl v2 returns results organized by source type (web, images, news). We primarily use web results for the unified format. Args: raw_response: Raw httpx response from Firecrawl API logging_obj: Logging object for tracking Returns: SearchResponse with standardized format r-Zwebr2 descriptiontitleurlN)r@rAsnippetdateZ last_updatednewsrBrCsearch)resultsobject)jsongetr appendr ) r)r<r=r*Z response_jsonrFr-Z web_resultsresultrBZ search_resultZ news_resultsrrrtransform_search_responses:         z/FirecrawlSearchConfig.transform_search_response)NN)N)rrrr. staticmethodrr#rrr+r7rrr0r;httpxResponseLiteLLMLoggingObjr rLrrrrr!(sN   :r!)rtypingrrrrrrNZ*litellm.litellm_core_utils.litellm_loggingrrPZ+litellm.llms.base_llm.search.transformationrr r Zlitellm.secret_managers.mainr r rr!rrrrs