ݫGi"dZddlZddlmZ ddlmZdZdZdZ d Z d Z d Z d Z d ZdZdZy#e$r ddlmZY,wxYw)z- Database utilities for Link Checker package N)RealDictCursor) DatabaseErrorc tj|d|d|d|d}|jddrd|_|j t }||fS#t $r}td |d }~wwxYw) z Get database connection Args: config (dict): Database configuration Returns: tuple: (connection, cursor) hostuserpassworddbname)rrr r autocommitT)cursor_factoryzFailed to connect to database: N)psycopg2connectgetr cursorr Exceptionr)configconcures 8/var/www/html/utilities/link_checker_package/database.pyget_connectionrs CJ'(#   ::lD )!CNjjj7Cx C=aSABBCsAA A6#A11A6c  d}|j||j}|D]}|d}d|z}||vs|}nd}|j||g|j}|js|iddddS|d}|jd |jd |jd |jd |jd |jd|jd|jdd} |jd} d} | rd| vrd} || | |jd| dS#t$r} t d| d} ~ wwxYw)z Get website settings from database Args: cur: Database cursor display_link (str): Display link Returns: dict: Website settings zSELECT * FROM merge_websitessite_url.z2SELECT * FROM websites WHERE website_site_url = %sFN) display_linkwebsite_settings cloudflareaverage_removal_time hosting_emailrcheck_http_code http_codescheck_stop_words stopwordshomepage_redirectcheck_stop_words_on_page use_seleniumuse_playwright)r r!r"r#r$r%r&r'website_hosting_emailcloudflare.comTrz Failed to get website settings: )executefetchallrowcountrrr) rrsqlmergesmerge website_merge awebsite_urlwebsites website_rowrrrrs rget_website_settingsr4's4D, C E!*-M.L|+,   C C,(<<>|| ,$&#(,!%  qk */@A%//,7 +0B C$5!,1D!E(38R(S'OON;)oo.>?  $(?@  ->J) 0$$/OO4J$K*    D>qcBCCDs#6D1=D17B9D11 E :EE c @ d}|j||g|jsiS|j}|dd}d}|j|t|g|j}|jsiS|d}|j d|j d|j d|j d|j d |j d |j d |j d d S#t $r}t d|d}~wwxYw)z Get content type settings for a project Args: cur: Database cursor project_id (int): Project ID Returns: dict: Content type settings z9SELECT * FROM project_content_types WHERE project_id = %srcontent_type_idz6SELECT * FROM content_types WHERE content_type_id = %sr r!r" stop_wordsr$r%r&r')r r!r"r7r$r%r&r'z%Failed to get content type settings: N)r*r,r+strrrr)r project_idr-rowsr6rowsscontent_type_rowrs rget_content_type_settingsr=hs%II C*&||I||~q'"34F C#o./0 ||I 8/334EF*..|< 0 4 45G H*..|h C),)9vay%CtC >8<==>s9>> AAAc d|zdz}|j||j}|S#t$r}td|d}~wwxYw)z Get cookies for social media platforms Args: cur: Database cursor table (str): Cookie table name Returns: list: Cookie records zSELECT * FROM z LIMIT 1zFailed to get cookies: N)r*r+rr)rtabler-r:rs r get_cookiesrWsU;&3 C||~ ;5aS9::;s*- A AA c ddl}d}d}|j||g|j}|dd}|j|}|dj d}|S#t $r}t d|d}~wwxYw) z Get deleted keywords for content checking Args: cur: Database cursor Returns: list: Deleted keywords rNz2SELECT * FROM user_groups WHERE user_group_id = %ssettings)keywords_detecting_remove_pirated_contentz z Failed to get deleted keywords: )jsonr*r+loadssplitrr) rr\ user_group_idr-r:rZkeywordsdeleted_keywordsrs rget_deleted_keywordsrbs D B C-)||~7:&::h'#$OPVVW]^ D>qcBCCDsAA A8%A33A8c,|syd|jvS)z Check if website is cloudflare based on hosting email Args: hosting_email (str): Hosting email from database Returns: bool: True if cloudflare, False otherwise Fr))lower)rs ris_cloudflare_websiteres  }224 44)__doc__r psycopg2.extrasr exceptionsr ImportErrorrr4r=rIrMrPrTrWrbrerfrrlsi*))C2?DB'IR'LR;&;(>$;&D0 5g)()s3 AA