zh|ddlmZddlZddlmZmZmZmZmZm Z m Z m Z ddl m Z erddlZej eZe eeeeeefZd dZddZGdde d ZGd d Zy)) annotationsN) TYPE_CHECKINGAnyCallableListLiteralOptionalSequenceUnion) TypedDictcddl}t|dk(st|dk(r|jgS|j|}|j|}|jd|jdk7r&t d|jd|jd ddl}|j||j }|j||j }d|j||d z }t|tr|j|gS|j|S#t$rtjd |jj|d }|jj|d }|jd d 5|j ||j"|j$||z }dddn #1swYnxYwd|j&||j(|z<|cYSwxYw)z>? s2A9D)D))A,H 2G H G 1H H cR ddlmdfd }|S#t$r tdwxYw)zGet the OpenAI GPT-3 encoder.r)ClientzTHe default encoder for the EmbeddingDistance class uses the OpenAI API. Please either install the openai library with `pip install openai` or provide a custom encoder function (Callable[[str], Sequence[float]]).c}|jjt|d}|jDcgc]}|jc}Scc}w)Nztext-embedding-3-small)inputmodel) embeddingscreatelistdata embedding)textsclientresponsed OpenAIClients r4 encode_textz(_get_openai_encoder..encode_textJsM$$++u+%=, &.]]3 333sA)r@z Sequence[str]returnzSequence[Sequence[float]])openair7r!)rErDs @r4_get_openai_encoderrH?s< 14    T   s&c"eZdZUded<ded<y)EmbeddingConfigz0Callable[[List[str]], Sequence[Sequence[float]]]encoderzCLiteral['cosine', 'euclidean', 'manhattan', 'chebyshev', 'hamming']rN)__name__ __module__ __qualname____annotations__r4rJrJTs == OOrQrJF)totalceZdZ d d dZ d dZd dZeddZed dZed dZ ed dZ ed d Z y)EmbeddingDistanceNc|xsi}|jdxsd|_|jdxs t|_y)NrrrK)getdistancerHrK)selfconfigs r4__init__zEmbeddingDistance.__init__Zs;2 8,8 zz),E0C0E rQc ddl}|j||g}|j|}|j |d|dj S#t$r tdwxYw)NrzWThe EmbeddingDistance class requires NumPy. Please install it with `pip install numpy`.r)rr!rKr_compute_distanceitem)rX prediction referencer.r;vectors r4evaluatezEmbeddingDistance.evaluatebsv    \\:y"9: *%%%fQi;@@BB '  s AA&c||jdk(r|j||S|jdk(r|j||S|jdk(r|j||S|jdk(r|j ||S|jdk(r|j ||St d|j)Nr euclidean manhattan chebyshevhammingzInvalid distance metric: )rW_cosine_distance_euclidean_distance_manhattan_distance_chebyshev_distance_hamming_distancer)rXabs r4r\z#EmbeddingDistance._compute_distancers ==H $((A. . ]]k )++Aq1 1 ]]k )++Aq1 1 ]]k )++Aq1 1 ]]i '))!Q/ /8HI IrQc$dt|g|gz S)zCompute the cosine distance between two vectors. Args: a (np.ndarray): The first vector. b (np.ndarray): The second vector. Returns: np.ndarray: The cosine distance. g?)r5rlrms r4rgz"EmbeddingDistance._cosine_distances&sQC000rQcFtjj||z S)zCompute the Euclidean distance between two vectors. Args: a (np.ndarray): The first vector. b (np.ndarray): The second vector. Returns: np.floating: The Euclidean distance. )r.r$r%ros r4rhz%EmbeddingDistance._euclidean_distancesyy~~a!e$$rQcXtjtj||z S)zCompute the Manhattan distance between two vectors. Args: a (np.ndarray): The first vector. b (np.ndarray): The second vector. Returns: np.floating: The Manhattan distance. )r.sumabsros r4riz%EmbeddingDistance._manhattan_distancevvbffQUm$$rQcXtjtj||z S)zCompute the Chebyshev distance between two vectors. Args: a (np.ndarray): The first vector. b (np.ndarray): The second vector. Returns: np.floating: The Chebyshev distance. )r.maxrsros r4rjz%EmbeddingDistance._chebyshev_distancertrQc2tj||k7S)zCompute the Hamming distance between two vectors. Args: a (np.ndarray): The first vector. b (np.ndarray): The second vector. Returns: np.floating: The Hamming distance. )r.meanros r4rkz#EmbeddingDistance._hamming_distanceswwqAvrQ)N)rYzOptional[EmbeddingConfig])r^strr_ryrFr )rl np.ndarrayrmrzrFz np.floating)rlrzrmrzrFrz) rLrMrNrZrar\ staticmethodrgrhrirjrkrPrQr4rTrTYs-1F)FCCC  C J 1 1 % % % % % %  rQrT)r,Matrixr-r|rFrz)rFz4Callable[[Sequence[str]], Sequence[Sequence[float]]]) __future__rloggingtypingrrrrrr r r typing_extensionsr rr. getLoggerrLr"r r|r5rHrJrTrPrQr4rs~"   (   8 $ tDK $s)S0 1"J*PiuP ffrQ