{hrdZddlZddlmZmZmZmZddlZddlZddl m Z ddl m Z m Z mZdZGdde Zy) zWUtil that calls Metaphor Search API. In order to set this up, follow instructions at: N)AnyDictListOptionalget_from_dict_or_env) BaseModel ConfigDictmodel_validatorzhttps://api.metaphor.systemsceZdZUdZeed<dZeed<edZ dded ed e e ed e e ed e ed e ede ede ede e de e fdZedededefdZ dded ed e e ed e e ed e ed e ede ede ede e de efdZ dded ed e e ed e e ed e ed e ede ede ede e de efdZde ede efdZy)MetaphorSearchAPIWrapperz Wrapper for Metaphor Search API.metaphor_api_key kforbid)extraNquery num_resultsinclude_domainsexclude_domainsstart_crawl_dateend_crawl_datestart_published_dateend_published_dateuse_autopromptreturnc d|ji} ||||||||| d } tjtd| | } | j | j } | dS)N X-Api-Key numResultsrincludeDomainsexcludeDomainsstartCrawlDate endCrawlDatestartPublishedDateendPublishedDate useAutoprompt/search)headersjsonresults)rrequestspostMETAPHOR_API_URLraise_for_statusr*)selfrrrrrrrrrr)paramsresponsesearch_resultss g/var/www/html/engine/venv/lib/python3.12/site-packages/langchain_community/utilities/metaphor_search.py_metaphor_search_resultsz1MetaphorSearchAPIWrapper._metaphor_search_resultss{ 5 56%--.*"6 2+  ==  (   !!#!i((before)modevaluesc*t|dd}||d<|S)z9Validate that api key and endpoint exists in environment.rMETAPHOR_API_KEYr)clsr9rs r4validate_environmentz-MetaphorSearchAPIWrapper.validate_environment>s*0 &(: &6!" r6c X|j|||||||||  } |j| S)aLRun query through Metaphor Search and return metadata. Args: query: The query to search for. num_results: The number of results to return. include_domains: A list of domains to include in the search. Only one of include_domains and exclude_domains should be defined. exclude_domains: A list of domains to exclude from the search. Only one of include_domains and exclude_domains should be defined. start_crawl_date: If specified, only pages we crawled after start_crawl_date will be returned. end_crawl_date: If specified, only pages we crawled before end_crawl_date will be returned. start_published_date: If specified, only pages published after start_published_date will be returned. end_published_date: If specified, only pages published before end_published_date will be returned. use_autoprompt: If true, we turn your query into a more Metaphor-friendly query. Adds latency. Returns: A list of dictionaries with the following keys: title - The title of the page url - The url author - Author of the content, if applicable. Otherwise, None. published_date - Estimated date published in YYYY-MM-DD format. Otherwise, None. )rrrrrrrr)r5_clean_results) r0rrrrrrrrrraw_search_resultss r4r+z MetaphorSearchAPIWrapper.resultsIsJB":: #++-)!51);  ""#566r6c  Kdtf f d } | d{} tj| } j| dS7-w)z8Get results from the Metaphor Search API asynchronously.rc . Kd ji}   d }tj4d{}|jtd||4d{}|j dk(r<|j d{}|cdddd{cdddd{Std|j d|j77v7Q7A72#1d{7swYnxYwdddd{7y#1d{7swYyxYww)Nrrr()r*r)zError z: ) raiohttp ClientSessionr-r.statustext Exceptionreason)r)r1sessionresdatarrrrrrr0rrrs r4fetchz5MetaphorSearchAPIWrapper.results_async..fetchs:"D$9$9:G)"1"1"2 .&:$6!/ F,,. M M'"<<'(0vw(MMzzS(%(XXZ/# MMM M M M(& Bszzl(KLL MM 0 M MMMM M M M M Ms3DCD DCD#CCC DCD D$C%D*%CDDCDDC+ C" C+ 'D. D9C<:DDD DDNr+)strr*loadsr?) r0rrrrrrrrrrMresults_json_str results_jsons `````````` r4 results_asyncz&MetaphorSearchAPIWrapper.results_asyncwsR MS M M."'=zz"23 ""< #:;;)s AA.Ar@c g}|D]X}|j|jdd|jdd|jdd|jddd Z|S) Ntitlez Unknown Titleurlz Unknown URLauthorzUnknown Author publishedDatez Unknown Date)rTrUrVpublished_date)appendget)r0r@cleaned_resultsresults r4r?z'MetaphorSearchAPIWrapper._clean_resultssj( F  " "#ZZA!::e];$jj3CD&,jj.&Q   r6)NNNNNNN)__name__ __module__ __qualname____doc__rN__annotations__rintr model_configrrbooldictr5r classmethodrrr=r+rRr?r6r4r r sf* AsKL04/3*.(,.2,0)-!)!)!)"$s), !) "$s), !) #3- !)! !)'sm!)%SM!)!!) d!)F(#$3$04/3*.(,.2,0)-,7,7,7"$s), ,7 "$s), ,7 #3- ,7! ,7'sm,7%SM,7!,7 d,7d04/3*.(,.2,0)-(<(<(<"$s), (< "$s), (< #3- (<! (<'sm(<%SM(<!(< d(rks8  ,,5;;1[y[r6