sarvesh telegram bot to post automatically deals. scrape desidime latest deals, and sharing them on telegram.

<p> <span style="background-color: #1f1f1f; color: #c586c0; font-family: Menlo, Monaco, "Courier New", monospace; font-size: 12px; white-space: pre;">import</span><span style="background-color: #1f1f1f; color: #cccccc; font-family: Menlo, Monaco, "Courier New", monospace; font-size: 12px; white-space: pre;"> </span><span style="background-color: #1f1f1f; color: #4ec9b0; font-family: Menlo, Monaco, "Courier New", monospace; font-size: 12px; white-space: pre;">re</span></p><div style="background-color: #1f1f1f; color: #cccccc; font-family: Menlo, Monaco, "Courier New", monospace; font-size: 12px; line-height: 18px; white-space: pre;"><div><span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">asyncio</span></div><div><span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">logging</span></div><div><span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">requests</span></div><div><span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">traceback</span></div><div><span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">urllib</span>.<span style="color: #4ec9b0;">parse</span></div><div><span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">bitlyshortener</span></div><div><span style="color: #c586c0;">from</span> <span style="color: #4ec9b0;">aioify</span> <span style="color: #c586c0;">import</span> <span style="color: #dcdcaa;">aioify</span></div><div><span style="color: #c586c0;">from</span> <span style="color: #4ec9b0;">typing</span> <span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">Union</span></div><div><span style="color: #c586c0;">from</span> <span style="color: #4ec9b0;">bs4</span> <span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">BeautifulSoup</span></div><div><span style="color: #c586c0;">from</span> <span style="color: #4ec9b0;">multiprocessing</span> <span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">Process</span></div><div><span style="color: #c586c0;">from</span> <span style="color: #4ec9b0;">pyrogram</span> <span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">Client</span>, <span style="color: #4ec9b0;">errors</span>, <span style="color: #4ec9b0;">filters</span>, <span style="color: #4ec9b0;">types</span>, <span style="color: #9cdcfe;">idle</span>, <span style="color: #4ec9b0;">handlers</span>, <span style="color: #4ec9b0;">enums</span></div><br /><div><span style="color: #4ec9b0;">logging</span>.<span style="color: #dcdcaa;">basicConfig</span>(</div><div> <span style="color: #9cdcfe;">format</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">'</span><span style="color: #569cd6;">%(name)s</span><span style="color: #ce9178;"> - </span><span style="color: #569cd6;">%(levelname)s</span><span style="color: #ce9178;"> - </span><span style="color: #569cd6;">%(message)s</span><span style="color: #ce9178;">'</span>,</div><div> <span style="color: #9cdcfe;">handlers</span><span style="color: #d4d4d4;">=</span>[<span style="color: #4ec9b0;">logging</span>.<span style="color: #4ec9b0;">StreamHandler</span>()],</div><div> <span style="color: #9cdcfe;">level</span><span style="color: #d4d4d4;">=</span><span style="color: #4ec9b0;">logging</span>.<span style="color: #9cdcfe;">INFO</span></div><div>)</div><div><span style="color: #9cdcfe;">logger</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">logging</span>.<span style="color: #dcdcaa;">getLogger</span>(<span style="color: #9cdcfe;">__name__</span>)</div><div><span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Starting Bot ..."</span>)</div><br /><br /><div><span style="color: #9cdcfe;">app</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">Client</span>(</div><div> <span style="color: #9cdcfe;">name</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"pryogram"</span>,</div><div> <span style="color: #9cdcfe;">no_updates</span><span style="color: #d4d4d4;">=</span><span style="color: #569cd6;">True</span>,</div><div> <span style="color: #9cdcfe;">in_memory</span><span style="color: #d4d4d4;">=</span><span style="color: #569cd6;">True</span>,</div><div> <span style="color: #9cdcfe;">api_id</span><span style="color: #d4d4d4;">=</span><span style="color: #b5cea8;">2879766</span>,</div><div> <span style="color: #9cdcfe;">api_hash</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"089d771e15ecee0bd0cbe58e2e218423"</span>,</div><div> <span style="color: #9cdcfe;">session_string</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"BQCLSbOG3HzIFOXYblfpjhkqkAC5G4uRz3Hs91d7y6Xb6qm3Lmm22mAFw2CJ7bXbcxvUb36dsMcOvRYvhHMExhbbhUXWwRkjBwJViI77Y5niQQHYJ5SOt0s4uCDW4qa5IUlfdrDlE6KAFDiQkt79258_olcdQBZwmsHGliY6c1qqc1pueueIbY-hBarmBC3Ggjg4W-TrGK32fMSC7N37nIJOvUvwVG-NLyIS5qy29GfRrxMV39b1ujcLYdk8WZy7SUeWSutQvfhD2GIUtq_hxA65eOHJUCA8vr9YIfkQ1Ru825L5Qz_1J06dob1tUlpM90aTgGl4KBBtvjMNzk6Ev-qzHbU4sgA"</span></div><div>)</div><div><span style="color: #9cdcfe;">app0_</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">Client</span>(</div><div> <span style="color: #9cdcfe;">name</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"updates_bot"</span>,</div><div> <span style="color: #9cdcfe;">in_memory</span><span style="color: #d4d4d4;">=</span><span style="color: #569cd6;">True</span>,</div><div> <span style="color: #9cdcfe;">api_id</span><span style="color: #d4d4d4;">=</span><span style="color: #b5cea8;">7188176</span>,</div><div> <span style="color: #9cdcfe;">api_hash</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"00354ec58538f2518bfcb45537a182e2"</span>,</div><div> <span style="color: #9cdcfe;">bot_token</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"5608478008:AAHa6h1-KuDl-5GzT9MQ9xfh93ol7-zBiQg"</span></div><div>)</div><div><span style="color: #4fc1ff;">LOCAL_DB</span> <span style="color: #d4d4d4;">=</span> {</div><div> <span style="color: #ce9178;">"isRunning"</span>: <span style="color: #569cd6;">True</span>,</div><div> <span style="color: #ce9178;">"authUserIDs"</span>: [<span style="color: #b5cea8;">498415794</span>, <span style="color: #b5cea8;">1445283714</span>]</div><div>}</div><br /><br /><div><span style="color: #569cd6;">async</span> <span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">__send_msg</span>(<span style="color: #9cdcfe;">_text</span>: <span style="color: #4ec9b0;">str</span>, <span style="color: #9cdcfe;">chat_id</span>: <span style="color: #4ec9b0;">Union</span>[<span style="color: #4ec9b0;">str</span>, <span style="color: #4ec9b0;">int</span>]):</div><div> <span style="color: #c586c0;">try</span>:</div><div> <span style="color: #c586c0;">async</span> <span style="color: #c586c0;">with</span> <span style="color: #9cdcfe;">app</span>:</div><div> <span style="color: #c586c0;">await</span> <span style="color: #9cdcfe;">app</span>.<span style="color: #dcdcaa;">send_message</span>(</div><div> <span style="color: #9cdcfe;">chat_id</span><span style="color: #d4d4d4;">=</span><span style="color: #9cdcfe;">chat_id</span>,</div><div> <span style="color: #9cdcfe;">text</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"✅ "</span> <span style="color: #d4d4d4;">+</span> <span style="color: #9cdcfe;">_text</span>,</div><div> <span style="color: #9cdcfe;">entities</span><span style="color: #d4d4d4;">=</span>[<span style="color: #4ec9b0;">types</span>.<span style="color: #4ec9b0;">MessageEntity</span>(</div><div> <span style="color: #9cdcfe;">type</span><span style="color: #d4d4d4;">=</span><span style="color: #4ec9b0;">enums</span>.<span style="color: #4ec9b0;">MessageEntityType</span>.<span style="color: #4fc1ff;">CUSTOM_EMOJI</span>,</div><div> <span style="color: #9cdcfe;">custom_emoji_id</span><span style="color: #d4d4d4;">=</span><span style="color: #b5cea8;">4983406439939703316</span>,</div><div> <span style="color: #9cdcfe;">offset</span><span style="color: #d4d4d4;">=</span><span style="color: #b5cea8;">0</span>,</div><div> <span style="color: #9cdcfe;">length</span><span style="color: #d4d4d4;">=</span><span style="color: #b5cea8;">1</span></div><div> )],</div><div> <span style="color: #9cdcfe;">disable_web_page_preview</span><span style="color: #d4d4d4;">=</span><span style="color: #569cd6;">True</span></div><div> )</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Sent Message ..."</span>)</div><div> <span style="color: #c586c0;">except</span> <span style="color: #4ec9b0;">errors</span>.<span style="color: #4ec9b0;">FloodWait</span> <span style="color: #c586c0;">as</span> <span style="color: #9cdcfe;">ex</span>:</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"Sleeping for </span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">ex</span>.<span style="color: #9cdcfe;">value</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">s ..."</span>)</div><div> <span style="color: #c586c0;">await</span> <span style="color: #4ec9b0;">asyncio</span>.<span style="color: #dcdcaa;">sleep</span>(<span style="color: #9cdcfe;">ex</span>.<span style="color: #9cdcfe;">value</span>)</div><div> <span style="color: #c586c0;">await</span> <span style="color: #dcdcaa;">__send_msg</span>(<span style="color: #9cdcfe;">_text</span>, <span style="color: #9cdcfe;">chat_id</span>)</div><br /><br /><div><span style="color: #569cd6;">async</span> <span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">send_message</span>(<span style="color: #9cdcfe;">_text</span>: <span style="color: #4ec9b0;">str</span>):</div><div> <span style="color: #9cdcfe;">chat_ids</span> <span style="color: #d4d4d4;">=</span> [<span style="color: #d4d4d4;">-</span><span style="color: #b5cea8;">1001388213936</span>,<span style="color: #d4d4d4;">-</span><span style="color: #b5cea8;">1001673930867</span>]</div><div> <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">chat_id</span> <span style="color: #c586c0;">in</span> <span style="color: #9cdcfe;">chat_ids</span>:</div><div> <span style="color: #c586c0;">await</span> <span style="color: #dcdcaa;">__send_msg</span>(<span style="color: #9cdcfe;">_text</span>, <span style="color: #9cdcfe;">chat_id</span>)</div><br /><br /><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">short_url</span>(<span style="color: #9cdcfe;">url</span>: <span style="color: #4ec9b0;">str</span>):</div><div> <span style="color: #c586c0;">try</span>:</div><div> <span style="color: #9cdcfe;">shortener</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">bitlyshortener</span>.<span style="color: #4ec9b0;">Shortener</span>(</div><div> <span style="color: #9cdcfe;">tokens</span><span style="color: #d4d4d4;">=</span>[</div><div> <span style="color: #ce9178;">"75fb7fd2b8e95792ce301afed3df25560053d3b9"</span>,</div><div> <span style="color: #ce9178;">"5f70de359cc334c43f6031f0a4efb80c9fe48998"</span>,</div><div> <span style="color: #ce9178;">"9b5242a5e0d6f182e23a6feeb38052ae1ac10564"</span></div><div> <span style="color: #ce9178;">"ed5cb3592ad31964c06ea117a8bae63a99393921"</span>,</div><div> ],</div><div> <span style="color: #9cdcfe;">max_cache_size</span><span style="color: #d4d4d4;">=</span><span style="color: #b5cea8;">256</span></div><div> )</div><div> <span style="color: #9cdcfe;">new_url</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">shortener</span>.<span style="color: #dcdcaa;">shorten_urls</span>([<span style="color: #9cdcfe;">url</span>])[<span style="color: #b5cea8;">0</span>]</div><div> <span style="color: #c586c0;">except</span>:</div><div> <span style="color: #9cdcfe;">new_url</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">url</span></div><div> <span style="color: #c586c0;">return</span> <span style="color: #9cdcfe;">new_url</span></div><br /><br /><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">scrape</span>(<span style="color: #9cdcfe;">_url</span>: <span style="color: #4ec9b0;">str</span>):</div><div> <span style="color: #9cdcfe;">text_</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">""</span></div><div> <span style="color: #9cdcfe;">res_</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">requests</span>.<span style="color: #dcdcaa;">get</span>(<span style="color: #ce9178;">"https://www.desidime.com/"</span><span style="color: #d4d4d4;">+</span><span style="color: #9cdcfe;">_url</span>)</div><div> <span style="color: #9cdcfe;">soup_</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">BeautifulSoup</span>(<span style="color: #9cdcfe;">res_</span>.<span style="color: #9cdcfe;">content</span>, <span style="color: #ce9178;">"lxml"</span>)</div><div> <span style="color: #9cdcfe;">title</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">soup_</span>.<span style="color: #dcdcaa;">find</span>(<span style="color: #ce9178;">"h1"</span>, <span style="color: #9cdcfe;">attrs</span><span style="color: #d4d4d4;">=</span>{<span style="color: #ce9178;">"class"</span>: <span style="color: #ce9178;">"f20 mb20 bold"</span>}).<span style="color: #9cdcfe;">text</span>.<span style="color: #dcdcaa;">strip</span>()</div><div> <span style="color: #9cdcfe;">offer_price</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">soup_</span>.<span style="color: #dcdcaa;">find</span>(<span style="color: #ce9178;">"div"</span>, <span style="color: #9cdcfe;">attrs</span><span style="color: #d4d4d4;">=</span>{<span style="color: #ce9178;">"class"</span>: <span style="color: #ce9178;">"dealprice"</span>}).<span style="color: #9cdcfe;">text</span>.<span style="color: #dcdcaa;">strip</span>()</div><div> <span style="color: #9cdcfe;">link</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">soup_</span>.<span style="color: #dcdcaa;">find</span>(<span style="color: #ce9178;">"div"</span>, <span style="color: #9cdcfe;">attrs</span><span style="color: #d4d4d4;">=</span>{<span style="color: #ce9178;">"class"</span>: <span style="color: #ce9178;">"mainpost usercomment"</span>}).<span style="color: #dcdcaa;">find</span>(<span style="color: #ce9178;">"a"</span>).<span style="color: #dcdcaa;">get</span>(<span style="color: #ce9178;">"href"</span>).<span style="color: #dcdcaa;">rsplit</span>(<span style="color: #ce9178;">"url="</span>, <span style="color: #b5cea8;">1</span>)[<span style="color: #d4d4d4;">-</span><span style="color: #b5cea8;">1</span>]</div><div> <span style="color: #9cdcfe;">link</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">urllib</span>.<span style="color: #4ec9b0;">parse</span>.<span style="color: #dcdcaa;">unquote</span>(<span style="color: #9cdcfe;">link</span>)</div><div> <span style="color: #c586c0;">if</span> <span style="color: #ce9178;">"flipkart.com"</span> <span style="color: #569cd6;">in</span> <span style="color: #9cdcfe;">link</span>:</div><div> <span style="color: #9cdcfe;">link</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">"https://www.paisawapas.com/rl/1670229?slug=flipkartearn&url="</span> <span style="color: #d4d4d4;">+</span> <span style="color: #4ec9b0;">urllib</span>.<span style="color: #4ec9b0;">parse</span>.<span style="color: #dcdcaa;">quote</span>(<span style="color: #9cdcfe;">link</span>)</div><div> <span style="color: #c586c0;">elif</span> <span style="color: #ce9178;">"myntra.com"</span> <span style="color: #569cd6;">in</span> <span style="color: #9cdcfe;">link</span>:</div><div> <span style="color: #9cdcfe;">link</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">"https://www.paisawapas.com/rl/1670229?slug=ep-myntra&url="</span> <span style="color: #d4d4d4;">+</span> <span style="color: #4ec9b0;">urllib</span>.<span style="color: #4ec9b0;">parse</span>.<span style="color: #dcdcaa;">quote</span>(<span style="color: #9cdcfe;">link</span>)</div><div> <span style="color: #c586c0;">elif</span> <span style="color: #ce9178;">"ajio.com"</span> <span style="color: #569cd6;">in</span> <span style="color: #9cdcfe;">link</span>:</div><div> <span style="color: #9cdcfe;">link</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">"https://www.paisawapas.com/rl/1670229?slug=ep-ajio&url="</span> <span style="color: #d4d4d4;">+</span> <span style="color: #4ec9b0;">urllib</span>.<span style="color: #4ec9b0;">parse</span>.<span style="color: #dcdcaa;">quote</span>(<span style="color: #9cdcfe;">link</span>)</div><div> <span style="color: #c586c0;">elif</span> <span style="color: #ce9178;">"amazon.in"</span> <span style="color: #569cd6;">in</span> <span style="color: #9cdcfe;">link</span>:</div><div> <span style="color: #c586c0;">if</span> <span style="color: #ce9178;">"tag="</span> <span style="color: #569cd6;">in</span> <span style="color: #9cdcfe;">link</span>:</div><div> <span style="color: #9cdcfe;">link</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">re</span>.<span style="color: #dcdcaa;">sub</span>(<span style="color: #569cd6;">r</span><span style="color: #d16969;">"tag=.</span><span style="color: #d7ba7d;">*</span><span style="color: #ce9178;">(</span><span style="color: #d16969;">&</span><span style="color: #ce9178;">)</span><span style="color: #d7ba7d;">?</span><span style="color: #d16969;">"</span>, <span style="color: #ce9178;">"tag=collab-earticledeal-21&ref=as_li_ss_tl"</span>, <span style="color: #9cdcfe;">link</span>)</div><div> <span style="color: #c586c0;">else</span>:</div><div> <span style="color: #c586c0;">if</span> <span style="color: #ce9178;">"/s?"</span> <span style="color: #569cd6;">in</span> <span style="color: #9cdcfe;">link</span>:</div><div> <span style="color: #9cdcfe;">link</span> <span style="color: #d4d4d4;">+=</span> <span style="color: #ce9178;">"&tag=collab-earticledeal-21&ref=as_li_ss_tl"</span></div><div> <span style="color: #c586c0;">elif</span> <span style="color: #ce9178;">"?"</span> <span style="color: #569cd6;">in</span> <span style="color: #9cdcfe;">link</span>:</div><div> <span style="color: #9cdcfe;">link</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">link</span>.<span style="color: #dcdcaa;">split</span>(<span style="color: #ce9178;">"?"</span>, <span style="color: #b5cea8;">1</span>)[<span style="color: #b5cea8;">0</span>]</div><div> <span style="color: #9cdcfe;">link</span> <span style="color: #d4d4d4;">+=</span> <span style="color: #ce9178;">"?tag=collab-earticledeal-21&ref=as_li_ss_tl"</span></div><div> <span style="color: #c586c0;">else</span>:</div><div> <span style="color: #9cdcfe;">link</span> <span style="color: #d4d4d4;">+=</span> <span style="color: #ce9178;">"?tag=collab-earticledeal-21&ref=as_li_ss_tl"</span></div><br /><div> <span style="color: #9cdcfe;">text_</span> <span style="color: #d4d4d4;">+=</span> <span style="color: #569cd6;">f</span><span style="color: #ce9178;">"</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">title</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;"> @ </span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">offer_price</span><span style="color: #569cd6;">}</span><span style="color: #d7ba7d;">\n\n</span><span style="color: #ce9178;">"</span> \</div><div> <span style="color: #569cd6;">f</span><span style="color: #ce9178;">"</span><span style="color: #569cd6;">{</span><span style="color: #dcdcaa;">short_url</span>(<span style="color: #9cdcfe;">link</span>)<span style="color: #569cd6;">}</span><span style="color: #ce9178;">"</span></div><div> <span style="color: #c586c0;">return</span> <span style="color: #9cdcfe;">text_</span></div><br /><br /><div><span style="color: #569cd6;">async</span> <span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">looped_run</span>():</div><div> <span style="color: #9cdcfe;">last_post_title</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">""</span></div><div> <span style="color: #c586c0;">while</span> <span style="color: #569cd6;">True</span>:</div><div> <span style="color: #c586c0;">if</span> <span style="color: #569cd6;">not</span> <span style="color: #4fc1ff;">LOCAL_DB</span>.<span style="color: #dcdcaa;">get</span>(<span style="color: #ce9178;">"isRunning"</span>):</div><div> <span style="color: #c586c0;">await</span> <span style="color: #4ec9b0;">asyncio</span>.<span style="color: #dcdcaa;">sleep</span>(<span style="color: #b5cea8;">1</span>)</div><div> <span style="color: #c586c0;">continue</span></div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Sleeping for 30s ..."</span>)</div><div> <span style="color: #c586c0;">await</span> <span style="color: #4ec9b0;">asyncio</span>.<span style="color: #dcdcaa;">sleep</span>(<span style="color: #b5cea8;">30</span>)</div><div> <span style="color: #c586c0;">try</span>:</div><div> <span style="color: #9cdcfe;">res</span> <span style="color: #d4d4d4;">=</span> <span style="color: #c586c0;">await</span> <span style="color: #dcdcaa;">aioify</span>(<span style="color: #9cdcfe;">obj</span><span style="color: #d4d4d4;">=</span><span style="color: #4ec9b0;">requests</span>.<span style="color: #dcdcaa;">get</span>)(<span style="color: #ce9178;">"https://www.desidime.com/new?deals_view=deal_text_view"</span>)</div><div> <span style="color: #9cdcfe;">soup</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">BeautifulSoup</span>(<span style="color: #9cdcfe;">res</span>.content, <span style="color: #ce9178;">"lxml"</span>)</div><div> <span style="color: #9cdcfe;">block</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">soup</span>.<span style="color: #dcdcaa;">find</span>(<span style="color: #ce9178;">"div"</span>, <span style="color: #9cdcfe;">attrs</span><span style="color: #d4d4d4;">=</span>{<span style="color: #ce9178;">"class"</span>: <span style="color: #ce9178;">"deal-text-item"</span>})</div><div> </div><div> <span style="color: #9cdcfe;">deal_type</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">block</span>.<span style="color: #dcdcaa;">find</span>(<span style="color: #ce9178;">"div"</span>, <span style="color: #9cdcfe;">attrs</span><span style="color: #d4d4d4;">=</span>{<span style="color: #ce9178;">"class"</span>: <span style="color: #ce9178;">"f16 cdblue"</span>}).<span style="color: #9cdcfe;">text</span>.<span style="color: #dcdcaa;">strip</span>()</div><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">deal_type</span> <span style="color: #569cd6;">not</span> <span style="color: #569cd6;">in</span> [<span style="color: #ce9178;">"Amazon"</span>, <span style="color: #ce9178;">"Flipkart"</span>, <span style="color: #ce9178;">"Myntra"</span>, <span style="color: #ce9178;">"ajio"</span>]:</div><div> <span style="color: #c586c0;">continue</span></div><div> <span style="color: #9cdcfe;">r_title</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">block</span>.<span style="color: #dcdcaa;">find</span>(<span style="color: #ce9178;">"div"</span>, <span style="color: #9cdcfe;">attrs</span><span style="color: #d4d4d4;">=</span>{<span style="color: #ce9178;">"class"</span>: <span style="color: #ce9178;">"deal-text-title"</span>}).<span style="color: #9cdcfe;">text</span>.<span style="color: #dcdcaa;">strip</span>()</div><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">r_title</span> <span style="color: #d4d4d4;">==</span> <span style="color: #9cdcfe;">last_post_title</span>:</div><div> <span style="color: #c586c0;">continue</span></div><div> <span style="color: #c586c0;">if</span> <span style="color: #569cd6;">not</span> <span style="color: #9cdcfe;">last_post_title</span>:</div><div> <span style="color: #9cdcfe;">last_post_title</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">r_title</span></div><div> <span style="color: #c586c0;">continue</span></div><div> <span style="color: #9cdcfe;">last_post_title</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">r_title</span></div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Got New Post ..."</span>)</div><div> <span style="color: #9cdcfe;">url</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">block</span>.<span style="color: #dcdcaa;">find</span>(<span style="color: #ce9178;">"div"</span>, <span style="color: #9cdcfe;">attrs</span><span style="color: #d4d4d4;">=</span>{<span style="color: #ce9178;">"class"</span>: <span style="color: #ce9178;">"deal-text-title"</span>}).<span style="color: #dcdcaa;">find</span>(<span style="color: #ce9178;">"a"</span>).<span style="color: #dcdcaa;">get</span>(<span style="color: #ce9178;">"href"</span>)</div><div> <span style="color: #6a9955;"># print("URL:- ", url)</span></div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Processing ..."</span>)</div><div> <span style="color: #9cdcfe;">text</span> <span style="color: #d4d4d4;">=</span> <span style="color: #c586c0;">await</span> <span style="color: #dcdcaa;">aioify</span>(<span style="color: #9cdcfe;">obj</span><span style="color: #d4d4d4;">=</span><span style="color: #dcdcaa;">scrape</span>)(<span style="color: #9cdcfe;">url</span>)</div><div> <span style="color: #c586c0;">if</span> <span style="color: #569cd6;">not</span> <span style="color: #9cdcfe;">text</span>:</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Skipped ..."</span>)</div><div> <span style="color: #c586c0;">continue</span></div><div> <span style="color: #c586c0;">await</span> <span style="color: #dcdcaa;">send_message</span>(<span style="color: #9cdcfe;">text</span>)</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Sent Post in Chat ..."</span>)</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">res</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">"</span>)</div><br /><div> <span style="color: #c586c0;">except</span> <span style="color: #4ec9b0;">Exception</span> <span style="color: #c586c0;">as</span> <span style="color: #9cdcfe;">e</span>:</div><div> <span style="color: #c586c0;">if</span> <span style="color: #4ec9b0;">str</span>(<span style="color: #9cdcfe;">e</span>).<span style="color: #dcdcaa;">strip</span>() <span style="color: #d4d4d4;">==</span> <span style="color: #ce9178;">"'NoneType' object has no attribute 'text'"</span>:</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Not a offer Post ..."</span>)</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">e</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">"</span>)</div><div> <span style="color: #c586c0;">continue</span></div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">e</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">"</span>)</div><div> <span style="color: #4ec9b0;">traceback</span>.<span style="color: #dcdcaa;">print_exc</span>()</div><div> <span style="color: #c586c0;">continue</span></div><br /><br /><div><span style="color: #569cd6;">async</span> <span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">updates_run</span>():</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Importing Handlers ..."</span>)</div><br /><div> <span style="color: #569cd6;">async</span> <span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">start_cmd</span>(<span style="color: #9cdcfe;">_</span>, <span style="color: #9cdcfe;">m</span>: <span style="color: #ce9178;">"</span><span style="color: #4ec9b0;">types</span><span style="color: #ce9178;">.</span><span style="color: #4ec9b0;">Message</span><span style="color: #ce9178;">"</span>):</div><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">m</span>.<span style="color: #9cdcfe;">from_user</span>.<span style="color: #9cdcfe;">id</span> <span style="color: #569cd6;">not</span> <span style="color: #569cd6;">in</span> <span style="color: #4fc1ff;">LOCAL_DB</span>[<span style="color: #ce9178;">"authUserIDs"</span>]:</div><div> <span style="color: #c586c0;">return</span></div><div> <span style="color: #4fc1ff;">LOCAL_DB</span>[<span style="color: #ce9178;">"isRunning"</span>] <span style="color: #d4d4d4;">=</span> <span style="color: #569cd6;">True</span></div><div> <span style="color: #c586c0;">return</span> <span style="color: #c586c0;">await</span> <span style="color: #9cdcfe;">m</span>.<span style="color: #dcdcaa;">reply_text</span>(</div><div> <span style="color: #9cdcfe;">text</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"Hi, I'm Running ..."</span>, <span style="color: #9cdcfe;">quote</span><span style="color: #d4d4d4;">=</span><span style="color: #569cd6;">True</span>, <span style="color: #9cdcfe;">disable_web_page_preview</span><span style="color: #d4d4d4;">=</span><span style="color: #569cd6;">True</span></div><div> )</div><br /><div> <span style="color: #569cd6;">async</span> <span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">stop_cmd</span>(<span style="color: #9cdcfe;">_</span>, <span style="color: #9cdcfe;">m</span>: <span style="color: #ce9178;">"</span><span style="color: #4ec9b0;">types</span><span style="color: #ce9178;">.</span><span style="color: #4ec9b0;">Message</span><span style="color: #ce9178;">"</span>):</div><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">m</span>.<span style="color: #9cdcfe;">from_user</span>.<span style="color: #9cdcfe;">id</span> <span style="color: #569cd6;">not</span> <span style="color: #569cd6;">in</span> <span style="color: #4fc1ff;">LOCAL_DB</span>[<span style="color: #ce9178;">"authUserIDs"</span>]:</div><div> <span style="color: #c586c0;">return</span></div><div> <span style="color: #4fc1ff;">LOCAL_DB</span>[<span style="color: #ce9178;">"isRunning"</span>] <span style="color: #d4d4d4;">=</span> <span style="color: #569cd6;">False</span></div><div> <span style="color: #c586c0;">return</span> <span style="color: #c586c0;">await</span> <span style="color: #9cdcfe;">m</span>.<span style="color: #dcdcaa;">reply_text</span>(</div><div> <span style="color: #9cdcfe;">text</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"Hi, I'm NOT Running ..."</span>, <span style="color: #9cdcfe;">quote</span><span style="color: #d4d4d4;">=</span><span style="color: #569cd6;">True</span>, <span style="color: #9cdcfe;">disable_web_page_preview</span><span style="color: #d4d4d4;">=</span><span style="color: #569cd6;">True</span></div><div> )</div><br /><div> <span style="color: #569cd6;">async</span> <span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">auth_cmd</span>(<span style="color: #9cdcfe;">_</span>, <span style="color: #9cdcfe;">m</span>: <span style="color: #ce9178;">"</span><span style="color: #4ec9b0;">types</span><span style="color: #ce9178;">.</span><span style="color: #4ec9b0;">Message</span><span style="color: #ce9178;">"</span>):</div><div> <span style="color: #4fc1ff;">LOCAL_DB</span>[<span style="color: #ce9178;">"authUserIDs"</span>].append(<span style="color: #4ec9b0;">int</span>(<span style="color: #9cdcfe;">m</span>.<span style="color: #9cdcfe;">text</span>.<span style="color: #dcdcaa;">split</span>(<span style="color: #ce9178;">" "</span>, <span style="color: #b5cea8;">1</span>)[<span style="color: #d4d4d4;">-</span><span style="color: #b5cea8;">1</span>]))</div><div> <span style="color: #c586c0;">return</span> <span style="color: #c586c0;">await</span> <span style="color: #9cdcfe;">m</span>.<span style="color: #dcdcaa;">reply_text</span>(<span style="color: #ce9178;">"Added in Auth ..."</span>, <span style="color: #569cd6;">True</span>)</div><br /><div> <span style="color: #9cdcfe;">start_cmd_handler</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">handlers</span>.<span style="color: #4ec9b0;">MessageHandler</span>(</div><div> <span style="color: #dcdcaa;">start_cmd</span>, <span style="color: #9cdcfe;">filters</span><span style="color: #d4d4d4;">=</span><span style="color: #4ec9b0;">filters</span>.<span style="color: #dcdcaa;">command</span>(<span style="color: #ce9178;">"start"</span>)</div><div> )</div><div> <span style="color: #9cdcfe;">app0_</span>.<span style="color: #dcdcaa;">add_handler</span>(<span style="color: #9cdcfe;">start_cmd_handler</span>)</div><div> <span style="color: #9cdcfe;">stop_cmd_handler</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">handlers</span>.<span style="color: #4ec9b0;">MessageHandler</span>(</div><div> <span style="color: #dcdcaa;">stop_cmd</span>, <span style="color: #9cdcfe;">filters</span><span style="color: #d4d4d4;">=</span><span style="color: #4ec9b0;">filters</span>.<span style="color: #dcdcaa;">command</span>(<span style="color: #ce9178;">"stop"</span>)</div><div> )</div><div> <span style="color: #9cdcfe;">app0_</span>.<span style="color: #dcdcaa;">add_handler</span>(<span style="color: #9cdcfe;">stop_cmd_handler</span>)</div><div> <span style="color: #9cdcfe;">auth_cmd_handler</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">handlers</span>.<span style="color: #4ec9b0;">MessageHandler</span>(</div><div> <span style="color: #dcdcaa;">auth_cmd</span>, <span style="color: #9cdcfe;">filters</span><span style="color: #d4d4d4;">=</span><span style="color: #4ec9b0;">filters</span>.<span style="color: #dcdcaa;">command</span>(<span style="color: #ce9178;">"auth"</span>) <span style="color: #dcdcaa;">&</span> <span style="color: #4ec9b0;">filters</span>.<span style="color: #4ec9b0;">user</span>([<span style="color: #b5cea8;">498415794</span>, <span style="color: #b5cea8;">1445283714</span>])</div><div> )</div><div> <span style="color: #9cdcfe;">app0_</span>.<span style="color: #dcdcaa;">add_handler</span>(<span style="color: #9cdcfe;">auth_cmd_handler</span>)</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Imported Successfully ..."</span>)</div><div> <span style="color: #c586c0;">await</span> <span style="color: #9cdcfe;">app0_</span>.<span style="color: #dcdcaa;">start</span>()</div><div> <span style="color: #c586c0;">await</span> <span style="color: #9cdcfe;">idle</span>()</div><div> <span style="color: #c586c0;">await</span> <span style="color: #9cdcfe;">app0_</span>.<span style="color: #dcdcaa;">stop</span>()</div><br /><br /><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">thread_with_looped_run</span>():</div><div> <span style="color: #c586c0;">try</span>:</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Looped Bot Started ..."</span>)</div><div> <span style="color: #4ec9b0;">asyncio</span>.<span style="color: #dcdcaa;">get_event_loop</span>().<span style="color: #dcdcaa;">run_until_complete</span>(<span style="color: #dcdcaa;">looped_run</span>())</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Lopped Bot Stopped ..."</span>)</div><div> <span style="color: #c586c0;">except</span> <span style="color: #4ec9b0;">Exception</span> <span style="color: #c586c0;">as</span> <span style="color: #9cdcfe;">err</span>:</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Looped Bot Stopped ..."</span>)</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #9cdcfe;">err</span>)</div><br /><br /><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">thread_with_updates_run</span>():</div><div> <span style="color: #c586c0;">try</span>:</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Updates Bot Started ..."</span>)</div><div> <span style="color: #4ec9b0;">asyncio</span>.<span style="color: #dcdcaa;">get_event_loop</span>().<span style="color: #dcdcaa;">run_until_complete</span>(<span style="color: #dcdcaa;">updates_run</span>())</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Updates Bot Stopped ..."</span>)</div><div> <span style="color: #c586c0;">except</span> <span style="color: #4ec9b0;">Exception</span> <span style="color: #c586c0;">as</span> <span style="color: #9cdcfe;">err</span>:</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Updates Bot Stopped ..."</span>)</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #9cdcfe;">err</span>)</div><br /><br /><div><span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">__name__</span> <span style="color: #d4d4d4;">==</span> <span style="color: #ce9178;">'__main__'</span>:</div><div> <span style="color: #c586c0;">try</span>:</div><div> <span style="color: #9cdcfe;">thread1</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">Process</span>(<span style="color: #9cdcfe;">target</span><span style="color: #d4d4d4;">=</span><span style="color: #dcdcaa;">thread_with_looped_run</span>)</div><div> <span style="color: #9cdcfe;">thread1</span>.<span style="color: #dcdcaa;">start</span>()</div><div> <span style="color: #9cdcfe;">thread2</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">Process</span>(<span style="color: #9cdcfe;">target</span><span style="color: #d4d4d4;">=</span><span style="color: #dcdcaa;">thread_with_updates_run</span>)</div><div> <span style="color: #9cdcfe;">thread2</span>.<span style="color: #dcdcaa;">start</span>()</div><div> <span style="color: #9cdcfe;">thread1</span>.<span style="color: #dcdcaa;">join</span>()</div><div> <span style="color: #9cdcfe;">thread2</span>.<span style="color: #dcdcaa;">join</span>()</div><div> <span style="color: #c586c0;">except</span>:</div><div> <span style="color: #9cdcfe;">logger</span>.<span style="color: #dcdcaa;">info</span>(<span style="color: #ce9178;">"Exiting ..."</span>)</div><div> <span style="color: #dcdcaa;">exit</span>()</div><br /></div>

sarvesh telegram bot to post automatically deals. scrape desidime latest deals, and sharing them on telegram.

  import re import asyncio import logging import requests import traceback import urllib . parse import bitlyshortener from aioify ...

Read more »

Youtube data scrape locally

<p> <span style="background-color: #1f1f1f; color: #c586c0; font-family: Menlo, Monaco, "Courier New", monospace; font-size: 12px; white-space: pre;">import</span><span style="background-color: #1f1f1f; color: #cccccc; font-family: Menlo, Monaco, "Courier New", monospace; font-size: 12px; white-space: pre;"> </span><span style="background-color: #1f1f1f; color: #4ec9b0; font-family: Menlo, Monaco, "Courier New", monospace; font-size: 12px; white-space: pre;">os</span></p><div style="background-color: #1f1f1f; color: #cccccc; font-family: Menlo, Monaco, "Courier New", monospace; font-size: 12px; line-height: 18px; white-space: pre;"><div><span style="color: #c586c0;">from</span> <span style="color: #4ec9b0;">googleapiclient</span>.<span style="color: #4ec9b0;">discovery</span> <span style="color: #c586c0;">import</span> <span style="color: #dcdcaa;">build</span></div><div><span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">csv</span></div><div><span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">time</span></div><br /><br /><div><span style="color: #6a9955;"># Replace with your API key</span></div><div><span style="color: #4fc1ff;">API_KEY</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">"###"</span></div><br /><div><span style="color: #6a9955;"># Create a YouTube Data API client</span></div><div><span style="color: #9cdcfe;">youtube</span> <span style="color: #d4d4d4;">=</span> <span style="color: #dcdcaa;">build</span>(<span style="color: #ce9178;">"youtube"</span>, <span style="color: #ce9178;">"v3"</span>, <span style="color: #9cdcfe;">developerKey</span><span style="color: #d4d4d4;">=</span><span style="color: #4fc1ff;">API_KEY</span>)</div><br /><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">get_channel_videos</span>(<span style="color: #9cdcfe;">channel_id</span>):</div><div> <span style="color: #9cdcfe;">videos</span> <span style="color: #d4d4d4;">=</span> []</div><div> <span style="color: #9cdcfe;">next_page_token</span> <span style="color: #d4d4d4;">=</span> <span style="color: #569cd6;">None</span></div><br /><div> <span style="color: #6a9955;"># Get the "uploads" playlist ID for the channel</span></div><div> <span style="color: #9cdcfe;">channels_response</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">youtube</span>.channels().list(</div><div> <span style="color: #9cdcfe;">id</span><span style="color: #d4d4d4;">=</span><span style="color: #9cdcfe;">channel_id</span>,</div><div> <span style="color: #9cdcfe;">part</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">'contentDetails'</span></div><div> ).execute()</div><br /><div> <span style="color: #9cdcfe;">uploads_playlist_id</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">channels_response</span>[<span style="color: #ce9178;">'items'</span>][<span style="color: #b5cea8;">0</span>][<span style="color: #ce9178;">'contentDetails'</span>][<span style="color: #ce9178;">'relatedPlaylists'</span>][<span style="color: #ce9178;">'uploads'</span>]</div><br /><div> <span style="color: #c586c0;">while</span> <span style="color: #569cd6;">True</span>:</div><div> <span style="color: #6a9955;"># Fetch the videos in the "uploads" playlist</span></div><div> <span style="color: #9cdcfe;">playlist_items_request</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">youtube</span>.playlistItems().list(</div><div> <span style="color: #9cdcfe;">playlistId</span><span style="color: #d4d4d4;">=</span><span style="color: #9cdcfe;">uploads_playlist_id</span>,</div><div> <span style="color: #9cdcfe;">part</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">'snippet'</span>,</div><div> <span style="color: #6a9955;"># maxResults=50,</span></div><div> <span style="color: #9cdcfe;">pageToken</span><span style="color: #d4d4d4;">=</span><span style="color: #9cdcfe;">next_page_token</span></div><div> )</div><div> <span style="color: #9cdcfe;">playlist_items_response</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">playlist_items_request</span>.execute()</div><br /><div> <span style="color: #6a9955;"># Extract video IDs</span></div><div> <span style="color: #9cdcfe;">video_ids</span> <span style="color: #d4d4d4;">=</span> [<span style="color: #9cdcfe;">item</span>[<span style="color: #ce9178;">'snippet'</span>][<span style="color: #ce9178;">'resourceId'</span>][<span style="color: #ce9178;">'videoId'</span>] <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">item</span> <span style="color: #c586c0;">in</span> <span style="color: #9cdcfe;">playlist_items_response</span>[<span style="color: #ce9178;">'items'</span>]]</div><br /><div> <span style="color: #6a9955;"># Fetch video details and statistics for each video ID</span></div><div> <span style="color: #9cdcfe;">videos_request</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">youtube</span>.videos().list(</div><div> <span style="color: #9cdcfe;">part</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"snippet,statistics"</span>,</div><div> <span style="color: #9cdcfe;">id</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">','</span>.<span style="color: #dcdcaa;">join</span>(<span style="color: #9cdcfe;">video_ids</span>)</div><div> )</div><div> <span style="color: #9cdcfe;">videos_response</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">videos_request</span>.execute()</div><br /><div> <span style="color: #6a9955;"># Process each video</span></div><div> <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">item</span> <span style="color: #c586c0;">in</span> <span style="color: #9cdcfe;">videos_response</span>[<span style="color: #ce9178;">'items'</span>]:</div><div> <span style="color: #9cdcfe;">video</span> <span style="color: #d4d4d4;">=</span> {</div><div> <span style="color: #ce9178;">"title"</span>: <span style="color: #9cdcfe;">item</span>[<span style="color: #ce9178;">'snippet'</span>][<span style="color: #ce9178;">'title'</span>],</div><div> <span style="color: #ce9178;">"views"</span>: <span style="color: #9cdcfe;">item</span>[<span style="color: #ce9178;">'statistics'</span>][<span style="color: #ce9178;">'viewCount'</span>],</div><div> <span style="color: #ce9178;">"video_link"</span>: <span style="color: #569cd6;">f</span><span style="color: #ce9178;">"https://www.youtube.com/watch?v=</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">item</span>[<span style="color: #ce9178;">'id'</span>]<span style="color: #569cd6;">}</span><span style="color: #ce9178;">"</span></div><div> }</div><div> <span style="color: #9cdcfe;">videos</span>.<span style="color: #dcdcaa;">append</span>(<span style="color: #9cdcfe;">video</span>)</div><br /><div> <span style="color: #6a9955;"># Check if there are more pages of results</span></div><div> <span style="color: #9cdcfe;">next_page_token</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">playlist_items_response</span>.get(<span style="color: #ce9178;">"nextPageToken"</span>)</div><div> <span style="color: #c586c0;">if</span> <span style="color: #569cd6;">not</span> <span style="color: #9cdcfe;">next_page_token</span>:</div><div> <span style="color: #c586c0;">break</span></div><br /><div> <span style="color: #c586c0;">return</span> <span style="color: #9cdcfe;">videos</span></div><br /><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">save_to_csv</span>(<span style="color: #9cdcfe;">videos</span>, <span style="color: #9cdcfe;">file_path</span>):</div><div> <span style="color: #6a9955;"># Define the field names (columns) for the CSV file</span></div><div> <span style="color: #9cdcfe;">field_names</span> <span style="color: #d4d4d4;">=</span> [<span style="color: #ce9178;">"Title"</span>, <span style="color: #ce9178;">"Views"</span>, <span style="color: #ce9178;">"Video Link"</span>]</div><br /><div> <span style="color: #6a9955;"># Write the video information to the CSV file</span></div><div> <span style="color: #c586c0;">with</span> <span style="color: #dcdcaa;">open</span>(<span style="color: #9cdcfe;">file_path</span>, <span style="color: #9cdcfe;">mode</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"w"</span>, <span style="color: #9cdcfe;">newline</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">""</span>, <span style="color: #9cdcfe;">encoding</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"utf-8"</span>) <span style="color: #c586c0;">as</span> <span style="color: #9cdcfe;">file</span>:</div><div> <span style="color: #9cdcfe;">writer</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">csv</span>.<span style="color: #4ec9b0;">DictWriter</span>(<span style="color: #9cdcfe;">file</span>, <span style="color: #9cdcfe;">fieldnames</span><span style="color: #d4d4d4;">=</span><span style="color: #9cdcfe;">field_names</span>)</div><div> <span style="color: #9cdcfe;">writer</span>.<span style="color: #dcdcaa;">writeheader</span>()</div><div> <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">video</span> <span style="color: #c586c0;">in</span> <span style="color: #9cdcfe;">videos</span>:</div><div> <span style="color: #9cdcfe;">writer</span>.<span style="color: #dcdcaa;">writerow</span>({</div><div> <span style="color: #ce9178;">"Title"</span>: <span style="color: #9cdcfe;">video</span>[<span style="color: #ce9178;">"title"</span>],</div><div> <span style="color: #ce9178;">"Views"</span>: <span style="color: #9cdcfe;">video</span>[<span style="color: #ce9178;">"views"</span>],</div><div> <span style="color: #ce9178;">"Video Link"</span>: <span style="color: #9cdcfe;">video</span>[<span style="color: #ce9178;">"video_link"</span>]</div><div> })</div><br /><br /><br /><br /><div><span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">__name__</span> <span style="color: #d4d4d4;">==</span> <span style="color: #ce9178;">"__main__"</span>:</div><div> <span style="color: #9cdcfe;">channel_id</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">"UCTA395IvJGrr7LBsqVAlJsw"</span> <span style="color: #6a9955;"># Replace with the channel ID of the target channel</span></div><div> <span style="color: #9cdcfe;">videos</span> <span style="color: #d4d4d4;">=</span> <span style="color: #dcdcaa;">get_channel_videos</span>(<span style="color: #9cdcfe;">channel_id</span>)</div><br /><div> <span style="color: #6a9955;"># Specify the path where you want to save the CSV file</span></div><div> <span style="color: #9cdcfe;">csv_file_path</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">"/Users/jitendersingh/Downloads/hindi med knowledge 20 apr 12 am.csv"</span></div><br /><div> <span style="color: #6a9955;"># Save video information to the CSV file</span></div><div> <span style="color: #dcdcaa;">save_to_csv</span>(<span style="color: #9cdcfe;">videos</span>, <span style="color: #9cdcfe;">csv_file_path</span>)</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #ce9178;">"Video information saved to"</span>, <span style="color: #9cdcfe;">csv_file_path</span>) Another file create for csv correction. <div style="line-height: 18px;"><div><span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">pandas</span> <span style="color: #c586c0;">as</span> <span style="color: #4ec9b0;">pd</span></div><div><span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">os</span></div><div><span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">time</span></div><br /><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">synchronize_csv_files</span>(<span style="color: #9cdcfe;">old_csv_path</span>, <span style="color: #9cdcfe;">new_csv_path</span>, <span style="color: #9cdcfe;">output_csv_path</span>):</div><div> <span style="color: #6a9955;"># Read the old and new CSV files into DataFrames</span></div><div> <span style="color: #9cdcfe;">old_df</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">pd</span>.<span style="color: #dcdcaa;">read_csv</span>(<span style="color: #9cdcfe;">old_csv_path</span>)</div><div> <span style="color: #9cdcfe;">new_df</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">pd</span>.<span style="color: #dcdcaa;">read_csv</span>(<span style="color: #9cdcfe;">new_csv_path</span>)</div><br /><div> <span style="color: #6a9955;"># Find the matching value in the first column of the second row in the new CSV</span></div><div> <span style="color: #9cdcfe;">matching_value</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">old_df</span>.<span style="color: #9cdcfe;">iloc</span>[<span style="color: #b5cea8;">1</span>, <span style="color: #b5cea8;">0</span>]</div><br /><div> <span style="color: #6a9955;"># Delete rows from the new CSV until the matching value is found in the first column</span></div><div> <span style="color: #c586c0;">while</span> <span style="color: #9cdcfe;">new_df</span>.<span style="color: #9cdcfe;">iloc</span>[<span style="color: #b5cea8;">1</span>, <span style="color: #b5cea8;">0</span>] <span style="color: #d4d4d4;">!=</span> <span style="color: #9cdcfe;">matching_value</span>:</div><div> <span style="color: #9cdcfe;">new_df</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">new_df</span>.<span style="color: #9cdcfe;">iloc</span>[<span style="color: #b5cea8;">1</span>:]</div><br /><div> <span style="color: #6a9955;"># Reset the index of the new DataFrame</span></div><div> <span style="color: #9cdcfe;">new_df</span>.<span style="color: #dcdcaa;">reset_index</span>(<span style="color: #9cdcfe;">drop</span><span style="color: #d4d4d4;">=</span><span style="color: #569cd6;">True</span>, <span style="color: #9cdcfe;">inplace</span><span style="color: #d4d4d4;">=</span><span style="color: #569cd6;">True</span>)</div><br /><div> <span style="color: #6a9955;"># Combine the rows from both CSV files into a single DataFrame</span></div><div> <span style="color: #9cdcfe;">combined_df</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">pd</span>.<span style="color: #dcdcaa;">concat</span>([<span style="color: #9cdcfe;">old_df</span>, <span style="color: #9cdcfe;">new_df</span>], <span style="color: #9cdcfe;">axis</span><span style="color: #d4d4d4;">=</span><span style="color: #b5cea8;">1</span>)</div><br /><div> <span style="color: #6a9955;"># Save the synchronized CSV to the output file</span></div><div> <span style="color: #9cdcfe;">combined_df</span>.<span style="color: #dcdcaa;">to_csv</span>(<span style="color: #9cdcfe;">output_csv_path</span>, <span style="color: #9cdcfe;">index</span><span style="color: #d4d4d4;">=</span><span style="color: #569cd6;">False</span>)</div><br /><br /><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">calculate_numbers</span>(<span style="color: #9cdcfe;">input_csv_path</span>, <span style="color: #9cdcfe;">output_csv_path</span>):</div><div> <span style="color: #6a9955;"># Read the synchronized CSV file into a DataFrame</span></div><div> <span style="color: #9cdcfe;">df</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">pd</span>.<span style="color: #dcdcaa;">read_csv</span>(<span style="color: #9cdcfe;">input_csv_path</span>)</div><br /><div> <span style="color: #6a9955;"># Calculate the result in the 6th column based on the values in the 2nd and 5th columns</span></div><div> <span style="color: #9cdcfe;">df</span>[<span style="color: #ce9178;">'GAP'</span>] <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">df</span>[<span style="color: #ce9178;">'Views.1'</span>] <span style="color: #dcdcaa;">-</span> <span style="color: #9cdcfe;">df</span>[<span style="color: #ce9178;">'Views'</span>]</div><br /><div> <span style="color: #6a9955;"># Save the modified CSV to the output file with a new name</span></div><div> <span style="color: #9cdcfe;">df</span>.<span style="color: #dcdcaa;">to_csv</span>(<span style="color: #9cdcfe;">output_csv_path</span>, <span style="color: #9cdcfe;">index</span><span style="color: #d4d4d4;">=</span><span style="color: #569cd6;">False</span>)</div><br /><br /><div><span style="color: #9cdcfe;">channel_name</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">"Tech Droid Hindi"</span></div><div><span style="color: #6a9955;"># Example usage:</span></div><div><span style="color: #9cdcfe;">old_csv_path</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">"/Users/jitendersingh/Downloads/"</span><span style="color: #d4d4d4;">+</span><span style="color: #9cdcfe;">channel_name</span><span style="color: #d4d4d4;">+</span><span style="color: #ce9178;">" 11 apr 11 am.csv"</span></div><div><span style="color: #9cdcfe;">new_csv_path</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">"/Users/jitendersingh/Downloads/"</span><span style="color: #d4d4d4;">+</span><span style="color: #9cdcfe;">channel_name</span><span style="color: #d4d4d4;">+</span><span style="color: #ce9178;">" 12 apr 11 am.csv"</span></div><div><span style="color: #9cdcfe;">output_csv_path</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">"/Users/jitendersingh/Downloads/temp_csv.csv"</span></div><br /><div><span style="color: #dcdcaa;">synchronize_csv_files</span>(<span style="color: #9cdcfe;">old_csv_path</span>, <span style="color: #9cdcfe;">new_csv_path</span>, <span style="color: #9cdcfe;">output_csv_path</span>)</div><div><span style="color: #6a9955;"># Example usage:</span></div><div><span style="color: #9cdcfe;">input_csv_path</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">"/Users/jitendersingh/Downloads/temp_csv.csv"</span></div><div><span style="color: #9cdcfe;">output_csv_path</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">"/Users/jitendersingh/Downloads/"</span><span style="color: #d4d4d4;">+</span><span style="color: #9cdcfe;">channel_name</span><span style="color: #d4d4d4;">+</span><span style="color: #ce9178;">" 24 hours.csv"</span></div><br /><div><span style="color: #dcdcaa;">calculate_numbers</span>(<span style="color: #9cdcfe;">input_csv_path</span>, <span style="color: #9cdcfe;">output_csv_path</span>)</div><br /><div><span style="color: #4ec9b0;">time</span>.<span style="color: #dcdcaa;">sleep</span>(<span style="color: #b5cea8;">1</span>)</div><div><span style="color: #4ec9b0;">os</span>.<span style="color: #dcdcaa;">remove</span>(<span style="color: #ce9178;">"/Users/jitendersingh/Downloads/temp_csv.csv"</span>)</div><br /><br /></div> </div><br /><br /><br /><br /></div>

Youtube data scrape locally

  import os from googleapiclient . discovery import build import csv import time # Replace with your API key API_KEY = "###...

Read more »

Youtube channel keywords extractor. get channel link from sheet and creating new sheet for channels.

<p> <span style="background-color: #1f1f1f; color: #c586c0; font-family: Menlo, Monaco, "Courier New", monospace; font-size: 12px; white-space: pre;">import</span><span style="background-color: #1f1f1f; color: #cccccc; font-family: Menlo, Monaco, "Courier New", monospace; font-size: 12px; white-space: pre;"> </span><span style="background-color: #1f1f1f; color: #4ec9b0; font-family: Menlo, Monaco, "Courier New", monospace; font-size: 12px; white-space: pre;">re</span></p><div style="background-color: #1f1f1f; color: #cccccc; font-family: Menlo, Monaco, "Courier New", monospace; font-size: 12px; line-height: 18px; white-space: pre;"><div><span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">gspread</span></div><div><span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">datetime</span></div><div><span style="color: #c586c0;">from</span> <span style="color: #4ec9b0;">googleapiclient</span>.<span style="color: #4ec9b0;">discovery</span> <span style="color: #c586c0;">import</span> <span style="color: #dcdcaa;">build</span></div><div><span style="color: #c586c0;">import</span> <span style="color: #4ec9b0;">time</span> <span style="color: #c586c0;">as</span> <span style="color: #4ec9b0;">tm</span></div><br /><br /><div><br /></div><br /><div><span style="color: #9cdcfe;">sa</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">gspread</span>.<span style="color: #dcdcaa;">service_account</span>(<span style="color: #9cdcfe;">filename</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"/Users/jitendersingh/Documents/sheetsapi.json"</span>)</div><div><span style="color: #9cdcfe;">sh</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">sa</span>.<span style="color: #dcdcaa;">open</span>(<span style="color: #ce9178;">'YT_Channel_views'</span>)</div><div><span style="color: #9cdcfe;">sheet</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">sh</span>.<span style="color: #dcdcaa;">worksheet</span>(<span style="color: #ce9178;">'Sheet1'</span>)</div><br /><br /><div><span style="color: #6a9955;"># Replace with your API key</span></div><div><span style="color: #4fc1ff;">API_KEY</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">"AIzaSyDytk3KmNuIs5cnT5jMJOV684Uq0LRKXNo"</span></div><br /><div><span style="color: #6a9955;"># Create a YouTube Data API client</span></div><div><span style="color: #9cdcfe;">youtube</span> <span style="color: #d4d4d4;">=</span> <span style="color: #dcdcaa;">build</span>(<span style="color: #ce9178;">"youtube"</span>, <span style="color: #ce9178;">"v3"</span>, <span style="color: #9cdcfe;">developerKey</span><span style="color: #d4d4d4;">=</span><span style="color: #4fc1ff;">API_KEY</span>)</div><br /><div><span style="color: #6a9955;">#Function to get youtube videos title, views, link</span></div><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">get_channel_videos</span>(<span style="color: #9cdcfe;">channel_id</span>):</div><div> <span style="color: #9cdcfe;">videos</span> <span style="color: #d4d4d4;">=</span> []</div><div> <span style="color: #9cdcfe;">next_page_token</span> <span style="color: #d4d4d4;">=</span> <span style="color: #569cd6;">None</span></div><br /><div> <span style="color: #6a9955;"># Get the "uploads" playlist ID for the channel</span></div><div> <span style="color: #9cdcfe;">channels_response</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">youtube</span>.channels().list(</div><div> <span style="color: #9cdcfe;">id</span><span style="color: #d4d4d4;">=</span><span style="color: #9cdcfe;">channel_id</span>,</div><div> <span style="color: #9cdcfe;">part</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">'contentDetails'</span></div><div> ).execute()</div><br /><div> <span style="color: #9cdcfe;">uploads_playlist_id</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">channels_response</span>[<span style="color: #ce9178;">'items'</span>][<span style="color: #b5cea8;">0</span>][<span style="color: #ce9178;">'contentDetails'</span>][<span style="color: #ce9178;">'relatedPlaylists'</span>][<span style="color: #ce9178;">'uploads'</span>]</div><br /><div> <span style="color: #c586c0;">while</span> <span style="color: #569cd6;">True</span>:</div><div> <span style="color: #6a9955;"># Fetch the videos in the "uploads" playlist</span></div><div> <span style="color: #9cdcfe;">playlist_items_request</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">youtube</span>.playlistItems().list(</div><div> <span style="color: #9cdcfe;">playlistId</span><span style="color: #d4d4d4;">=</span><span style="color: #9cdcfe;">uploads_playlist_id</span>,</div><div> <span style="color: #9cdcfe;">part</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">'snippet'</span>,</div><div> <span style="color: #6a9955;"># maxResults=50,</span></div><div> <span style="color: #9cdcfe;">pageToken</span><span style="color: #d4d4d4;">=</span><span style="color: #9cdcfe;">next_page_token</span></div><div> )</div><div> <span style="color: #9cdcfe;">playlist_items_response</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">playlist_items_request</span>.execute()</div><br /><div> <span style="color: #6a9955;"># Extract video IDs</span></div><div> <span style="color: #9cdcfe;">video_ids</span> <span style="color: #d4d4d4;">=</span> [<span style="color: #9cdcfe;">item</span>[<span style="color: #ce9178;">'snippet'</span>][<span style="color: #ce9178;">'resourceId'</span>][<span style="color: #ce9178;">'videoId'</span>] <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">item</span> <span style="color: #c586c0;">in</span> <span style="color: #9cdcfe;">playlist_items_response</span>[<span style="color: #ce9178;">'items'</span>]]</div><br /><div> <span style="color: #6a9955;"># Fetch video details and statistics for each video ID</span></div><div> <span style="color: #9cdcfe;">videos_request</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">youtube</span>.videos().list(</div><div> <span style="color: #9cdcfe;">part</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"snippet,statistics"</span>,</div><div> <span style="color: #9cdcfe;">id</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">','</span>.<span style="color: #dcdcaa;">join</span>(<span style="color: #9cdcfe;">video_ids</span>)</div><div> )</div><div> <span style="color: #9cdcfe;">videos_response</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">videos_request</span>.execute()</div><br /><div> <span style="color: #6a9955;"># Process each video</span></div><div> <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">item</span> <span style="color: #c586c0;">in</span> <span style="color: #9cdcfe;">videos_response</span>[<span style="color: #ce9178;">'items'</span>]:</div><div> <span style="color: #9cdcfe;">video</span> <span style="color: #d4d4d4;">=</span> {</div><div> <span style="color: #ce9178;">"title"</span>: <span style="color: #9cdcfe;">item</span>[<span style="color: #ce9178;">'snippet'</span>][<span style="color: #ce9178;">'title'</span>],</div><div> <span style="color: #ce9178;">"views"</span>: <span style="color: #9cdcfe;">item</span>[<span style="color: #ce9178;">'statistics'</span>][<span style="color: #ce9178;">'viewCount'</span>],</div><div> <span style="color: #ce9178;">"video_link"</span>: <span style="color: #569cd6;">f</span><span style="color: #ce9178;">"https://www.youtube.com/watch?v=</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">item</span>[<span style="color: #ce9178;">'id'</span>]<span style="color: #569cd6;">}</span><span style="color: #ce9178;">"</span></div><div> }</div><div> <span style="color: #9cdcfe;">videos</span>.<span style="color: #dcdcaa;">append</span>(<span style="color: #9cdcfe;">video</span>)</div><br /><div> <span style="color: #6a9955;"># Check if there are more pages of results</span></div><div> <span style="color: #9cdcfe;">next_page_token</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">playlist_items_response</span>.get(<span style="color: #ce9178;">"nextPageToken"</span>)</div><div> <span style="color: #c586c0;">if</span> <span style="color: #569cd6;">not</span> <span style="color: #9cdcfe;">next_page_token</span>:</div><div> <span style="color: #c586c0;">break</span></div><br /><div> <span style="color: #c586c0;">return</span> <span style="color: #9cdcfe;">videos</span></div><br /><br /><div><span style="color: #6a9955;">#Function to get youtube channel id using url / username (sometime username wont work)</span></div><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">get_channel_info_using_api</span>(<span style="color: #9cdcfe;">url</span>):</div><div> <span style="color: #ce9178;">"""</span></div><div><span style="color: #ce9178;"> Extracts channel ID or username and uses Youtube Data API to get channel name and ID.</span></div><br /><div><span style="color: #ce9178;"> Args:</span></div><div><span style="color: #ce9178;"> url: The URL of the YouTube channel.</span></div><br /><div><span style="color: #ce9178;"> Returns:</span></div><div><span style="color: #ce9178;"> A dictionary containing 'id' and 'name' keys, or None if parsing fails.</span></div><div><span style="color: #ce9178;"> """</span></div><div> <span style="color: #6a9955;"># Regex patterns for URL formats</span></div><div> <span style="color: #9cdcfe;">channel_id_pattern</span> <span style="color: #d4d4d4;">=</span> <span style="color: #569cd6;">r</span><span style="color: #d16969;">"channel/</span><span style="color: #ce9178;">([^</span><span style="color: #d16969;">/</span><span style="color: #ce9178;">]</span><span style="color: #d7ba7d;">+</span><span style="color: #ce9178;">)</span><span style="color: #d16969;">"</span></div><div> <span style="color: #9cdcfe;">username_pattern</span> <span style="color: #d4d4d4;">=</span> <span style="color: #569cd6;">r</span><span style="color: #d16969;">"@</span><span style="color: #ce9178;">([^</span><span style="color: #d16969;">/</span><span style="color: #ce9178;">]</span><span style="color: #d7ba7d;">+</span><span style="color: #ce9178;">)</span><span style="color: #d16969;">"</span></div><br /><div> <span style="color: #6a9955;"># Extract channel ID or username based on URL format</span></div><div> <span style="color: #9cdcfe;">match</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">re</span>.<span style="color: #dcdcaa;">search</span>(<span style="color: #9cdcfe;">channel_id_pattern</span>, <span style="color: #9cdcfe;">url</span>)</div><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">match</span>:</div><div> <span style="color: #9cdcfe;">channel_id</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">match</span>.<span style="color: #dcdcaa;">group</span>(<span style="color: #b5cea8;">1</span>)</div><div> <span style="color: #c586c0;">else</span>:</div><div> <span style="color: #9cdcfe;">match</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">re</span>.<span style="color: #dcdcaa;">search</span>(<span style="color: #9cdcfe;">username_pattern</span>, <span style="color: #9cdcfe;">url</span>)</div><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">match</span>:</div><div> <span style="color: #9cdcfe;">channel_username</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">match</span>.<span style="color: #dcdcaa;">group</span>(<span style="color: #b5cea8;">1</span>)</div><div> <span style="color: #9cdcfe;">channel_id</span> <span style="color: #d4d4d4;">=</span> <span style="color: #569cd6;">None</span> <span style="color: #6a9955;"># Initialize channel_id here to avoid the error</span></div><div> <span style="color: #c586c0;">else</span>:</div><div> <span style="color: #c586c0;">return</span> <span style="color: #569cd6;">None</span> <span style="color: #6a9955;"># URL format not recognized</span></div><br /><div> <span style="color: #6a9955;"># Use Youtube Data API to get channel information based on ID or username</span></div><div> <span style="color: #c586c0;">from</span> <span style="color: #4ec9b0;">googleapiclient</span>.<span style="color: #4ec9b0;">discovery</span> <span style="color: #c586c0;">import</span> <span style="color: #dcdcaa;">build</span> <span style="color: #6a9955;"># Import library for Youtube Data API</span></div><br /><div> <span style="color: #9cdcfe;">youtube</span> <span style="color: #d4d4d4;">=</span> <span style="color: #dcdcaa;">build</span>(<span style="color: #ce9178;">"youtube"</span>, <span style="color: #ce9178;">"v3"</span>, <span style="color: #9cdcfe;">developerKey</span><span style="color: #d4d4d4;">=</span><span style="color: #4fc1ff;">API_KEY</span>)</div><br /><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">channel_id</span>:</div><div> <span style="color: #6a9955;"># Get channel information by ID</span></div><div> <span style="color: #c586c0;">try</span>:</div><div> <span style="color: #9cdcfe;">response</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">youtube</span>.channels().list(</div><div> <span style="color: #9cdcfe;">part</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"snippet"</span>, <span style="color: #9cdcfe;">id</span><span style="color: #d4d4d4;">=</span><span style="color: #9cdcfe;">channel_id</span></div><div> ).execute()</div><div> <span style="color: #9cdcfe;">channel_name</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">response</span>[<span style="color: #ce9178;">"items"</span>][<span style="color: #b5cea8;">0</span>][<span style="color: #ce9178;">"snippet"</span>][<span style="color: #ce9178;">"title"</span>]</div><div> <span style="color: #c586c0;">return</span> {<span style="color: #ce9178;">"id"</span>: <span style="color: #9cdcfe;">channel_id</span>, <span style="color: #ce9178;">"name"</span>: <span style="color: #9cdcfe;">channel_name</span>}</div><div> <span style="color: #c586c0;">except</span>:</div><div> <span style="color: #c586c0;">return</span> <span style="color: #569cd6;">None</span> <span style="color: #6a9955;"># Handle potential errors during API call</span></div><div> <span style="color: #c586c0;">else</span>:</div><div> <span style="color: #6a9955;"># Get channel information by username (search by channel name)</span></div><div> <span style="color: #9cdcfe;">search_results</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">youtube</span>.search().list(</div><div> <span style="color: #9cdcfe;">q</span><span style="color: #d4d4d4;">=</span><span style="color: #9cdcfe;">channel_username</span>, <span style="color: #9cdcfe;">part</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"snippet"</span>, <span style="color: #9cdcfe;">type</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"CHANNEL"</span></div><div> ).execute()</div><div> <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">result</span> <span style="color: #c586c0;">in</span> <span style="color: #9cdcfe;">search_results</span>[<span style="color: #ce9178;">"items"</span>]:</div><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">result</span>[<span style="color: #ce9178;">"snippet"</span>][<span style="color: #ce9178;">"title"</span>] <span style="color: #d4d4d4;">==</span> <span style="color: #9cdcfe;">channel_username</span>:</div><div> <span style="color: #c586c0;">try</span>:</div><div> <span style="color: #9cdcfe;">channel_id</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">result</span>[<span style="color: #ce9178;">"snippet"</span>][<span style="color: #ce9178;">"channelId"</span>] <span style="color: #6a9955;"># Assign channel_id here</span></div><div> <span style="color: #9cdcfe;">response</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">youtube</span>.channels().list(</div><div> <span style="color: #9cdcfe;">part</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"snippet"</span>, <span style="color: #9cdcfe;">id</span><span style="color: #d4d4d4;">=</span><span style="color: #9cdcfe;">channel_id</span></div><div> ).execute()</div><div> <span style="color: #9cdcfe;">channel_name</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">response</span>[<span style="color: #ce9178;">"items"</span>][<span style="color: #b5cea8;">0</span>][<span style="color: #ce9178;">"snippet"</span>][<span style="color: #ce9178;">"title"</span>]</div><div> <span style="color: #c586c0;">return</span> {<span style="color: #ce9178;">"id"</span>: <span style="color: #9cdcfe;">channel_id</span>, <span style="color: #ce9178;">"name"</span>: <span style="color: #9cdcfe;">channel_name</span>}</div><div> <span style="color: #c586c0;">except</span>:</div><div> <span style="color: #c586c0;">return</span> <span style="color: #569cd6;">None</span> <span style="color: #6a9955;"># Handle potential errors during API call</span></div><div> <span style="color: #c586c0;">return</span> <span style="color: #569cd6;">None</span> <span style="color: #6a9955;"># Channel not found by username</span></div><br /><br /><br /><br /><div><span style="color: #6a9955;">#Function to and save before 24 hours data in sheet.</span></div><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">save_to_google_sheets</span>(<span style="color: #9cdcfe;">videos</span>, <span style="color: #9cdcfe;">worksheet_name</span>, <span style="color: #9cdcfe;">spreadsheet</span>):</div><div> <span style="color: #c586c0;">try</span>:</div><div> <span style="color: #6a9955;"># Try to open the specified worksheet, create it if it doesn't exist</span></div><div> <span style="color: #c586c0;">try</span>:</div><div> <span style="color: #9cdcfe;">worksheet</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">spreadsheet</span>.worksheet(<span style="color: #9cdcfe;">worksheet_name</span>)</div><div> <span style="color: #c586c0;">except</span> <span style="color: #4ec9b0;">gspread</span>.<span style="color: #4ec9b0;">exceptions</span>.<span style="color: #4ec9b0;">WorksheetNotFound</span>:</div><div> <span style="color: #9cdcfe;">worksheet</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">spreadsheet</span>.add_worksheet(<span style="color: #9cdcfe;">title</span><span style="color: #d4d4d4;">=</span><span style="color: #9cdcfe;">worksheet_name</span>, <span style="color: #9cdcfe;">cols</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"20"</span>, <span style="color: #9cdcfe;">rows</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"18000"</span>)</div><br /><div> <span style="color: #6a9955;"># Get the existing data range to append new data below it</span></div><div> <span style="color: #9cdcfe;">existing_data</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">worksheet</span>.get_all_values()</div><div> <span style="color: #9cdcfe;">start_row</span> <span style="color: #d4d4d4;">=</span> <span style="color: #dcdcaa;">len</span>(<span style="color: #9cdcfe;">existing_data</span>) <span style="color: #d4d4d4;">+</span> <span style="color: #b5cea8;">1</span> <span style="color: #6a9955;"># Start from the first empty row after existing data</span></div><br /><div> <span style="color: #6a9955;"># Prepare the data to be written</span></div><div> <span style="color: #9cdcfe;">data</span> <span style="color: #d4d4d4;">=</span> [[<span style="color: #9cdcfe;">video</span>[<span style="color: #ce9178;">"title"</span>], <span style="color: #9cdcfe;">video</span>[<span style="color: #ce9178;">"views"</span>], <span style="color: #9cdcfe;">video</span>[<span style="color: #ce9178;">"video_link"</span>]] <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">video</span> <span style="color: #c586c0;">in</span> <span style="color: #9cdcfe;">videos</span>]</div><br /><div> <span style="color: #6a9955;"># Append the data to the worksheet in batches</span></div><div> <span style="color: #9cdcfe;">batch_size</span> <span style="color: #d4d4d4;">=</span> <span style="color: #b5cea8;">100</span> <span style="color: #6a9955;"># Number of rows to append in each batch</span></div><div> <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">i</span> <span style="color: #c586c0;">in</span> <span style="color: #4ec9b0;">range</span>(<span style="color: #b5cea8;">0</span>, <span style="color: #dcdcaa;">len</span>(<span style="color: #9cdcfe;">data</span>), <span style="color: #9cdcfe;">batch_size</span>):</div><div> <span style="color: #9cdcfe;">batch</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">data</span>[<span style="color: #9cdcfe;">i</span>:<span style="color: #9cdcfe;">i</span><span style="color: #d4d4d4;">+</span><span style="color: #9cdcfe;">batch_size</span>]</div><div> <span style="color: #9cdcfe;">end_row</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">start_row</span> <span style="color: #d4d4d4;">+</span> <span style="color: #dcdcaa;">len</span>(<span style="color: #9cdcfe;">batch</span>) <span style="color: #d4d4d4;">-</span> <span style="color: #b5cea8;">1</span></div><div> <span style="color: #9cdcfe;">cell_range</span> <span style="color: #d4d4d4;">=</span> <span style="color: #569cd6;">f</span><span style="color: #ce9178;">"A</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">start_row</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">:C</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">end_row</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">"</span> <span style="color: #6a9955;"># Assuming the data starts from column A</span></div><div> <span style="color: #9cdcfe;">worksheet</span>.update(<span style="color: #9cdcfe;">cell_range</span>, <span style="color: #9cdcfe;">batch</span>)</div><div> <span style="color: #9cdcfe;">start_row</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">end_row</span> <span style="color: #d4d4d4;">+</span> <span style="color: #b5cea8;">1</span></div><br /><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #ce9178;">"Data saved to Google Sheets successfully."</span>)</div><div> <span style="color: #c586c0;">except</span> <span style="color: #4ec9b0;">gspread</span>.<span style="color: #4ec9b0;">exceptions</span>.<span style="color: #4ec9b0;">APIError</span> <span style="color: #c586c0;">as</span> <span style="color: #9cdcfe;">e</span>:</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #ce9178;">"Error: Unable to access Google Sheets API."</span>)</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #9cdcfe;">e</span>)</div><br /><br /><br /><div><span style="color: #6a9955;">#Function to save after 24 hours data in channel name's sheet.</span></div><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">save_to_google_sheets_after</span>(<span style="color: #9cdcfe;">videos</span>, <span style="color: #9cdcfe;">worksheet_name</span>, <span style="color: #9cdcfe;">spreadsheet</span>):</div><div> <span style="color: #c586c0;">try</span>:</div><div> <span style="color: #6a9955;"># Try to open the specified worksheet, if it exists</span></div><div> <span style="color: #9cdcfe;">worksheet</span> <span style="color: #d4d4d4;">=</span> <span style="color: #569cd6;">None</span></div><div> <span style="color: #9cdcfe;">worksheets</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">spreadsheet</span>.worksheets()</div><div> <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">ws</span> <span style="color: #c586c0;">in</span> <span style="color: #9cdcfe;">worksheets</span>:</div><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">ws</span>.title.lower() <span style="color: #d4d4d4;">==</span> <span style="color: #9cdcfe;">worksheet_name</span>.lower(): <span style="color: #6a9955;"># Case-insensitive comparison</span></div><div> <span style="color: #9cdcfe;">worksheet</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">ws</span></div><div> <span style="color: #c586c0;">break</span></div><br /><div> <span style="color: #c586c0;">if</span> <span style="color: #569cd6;">not</span> <span style="color: #9cdcfe;">worksheet</span>:</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"Worksheet '</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">worksheet_name</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">' not found."</span>)</div><div> <span style="color: #c586c0;">return</span> <span style="color: #6a9955;"># Exit the function if worksheet not found</span></div><br /><div> <span style="color: #9cdcfe;">start_row</span> <span style="color: #d4d4d4;">=</span> <span style="color: #b5cea8;">2</span> <span style="color: #6a9955;"># Start from the first empty row after existing data</span></div><br /><div> <span style="color: #6a9955;"># Prepare the data to be written</span></div><div> <span style="color: #9cdcfe;">data</span> <span style="color: #d4d4d4;">=</span> [[<span style="color: #9cdcfe;">video</span>[<span style="color: #ce9178;">"title"</span>], <span style="color: #9cdcfe;">video</span>[<span style="color: #ce9178;">"views"</span>], <span style="color: #9cdcfe;">video</span>[<span style="color: #ce9178;">"video_link"</span>]] <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">video</span> <span style="color: #c586c0;">in</span> <span style="color: #9cdcfe;">videos</span>]</div><br /><div> <span style="color: #6a9955;"># Append the data to the worksheet in batches</span></div><div> <span style="color: #9cdcfe;">batch_size</span> <span style="color: #d4d4d4;">=</span> <span style="color: #b5cea8;">100</span> <span style="color: #6a9955;"># Number of rows to append in each batch</span></div><div> <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">i</span> <span style="color: #c586c0;">in</span> <span style="color: #4ec9b0;">range</span>(<span style="color: #b5cea8;">0</span>, <span style="color: #dcdcaa;">len</span>(<span style="color: #9cdcfe;">data</span>), <span style="color: #9cdcfe;">batch_size</span>):</div><div> <span style="color: #9cdcfe;">batch</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">data</span>[<span style="color: #9cdcfe;">i</span>:<span style="color: #9cdcfe;">i</span><span style="color: #d4d4d4;">+</span><span style="color: #9cdcfe;">batch_size</span>]</div><div> <span style="color: #9cdcfe;">end_row</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">start_row</span> <span style="color: #d4d4d4;">+</span> <span style="color: #dcdcaa;">len</span>(<span style="color: #9cdcfe;">batch</span>) <span style="color: #d4d4d4;">-</span> <span style="color: #b5cea8;">1</span></div><div> <span style="color: #9cdcfe;">cell_range</span> <span style="color: #d4d4d4;">=</span> <span style="color: #569cd6;">f</span><span style="color: #ce9178;">"D</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">start_row</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">:F</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">end_row</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">"</span> <span style="color: #6a9955;"># Corrected cell range to cover columns D, E, and F</span></div><div> <span style="color: #9cdcfe;">worksheet</span>.update(<span style="color: #9cdcfe;">cell_range</span>, <span style="color: #9cdcfe;">batch</span>)</div><div> <span style="color: #9cdcfe;">start_row</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">end_row</span> <span style="color: #d4d4d4;">+</span> <span style="color: #b5cea8;">1</span></div><br /><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #ce9178;">"Data saved to Google Sheets successfully."</span>)</div><div> <span style="color: #c586c0;">except</span> <span style="color: #4ec9b0;">gspread</span>.<span style="color: #4ec9b0;">exceptions</span>.<span style="color: #4ec9b0;">APIError</span> <span style="color: #c586c0;">as</span> <span style="color: #9cdcfe;">e</span>:</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #ce9178;">"Error: Unable to access Google Sheets API."</span>)</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #9cdcfe;">e</span>)</div><br /><br /><br /><div><span style="color: #6a9955;">#Function to create before 24 hours sheet using channel name.</span></div><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">create_worksheet_for_channel</span>():</div><div> <span style="color: #6a9955;"># Get all non-empty cells in the first column of Sheet1</span></div><div> <span style="color: #9cdcfe;">first_column_cells</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">sheet</span>.<span style="color: #dcdcaa;">findall</span>(<span style="color: #4ec9b0;">re</span>.<span style="color: #dcdcaa;">compile</span>(<span style="color: #569cd6;">r</span><span style="color: #d16969;">'^https</span><span style="color: #d7ba7d;">?</span><span style="color: #d16969;">://'</span>))</div><div> </div><div> <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">cell</span> <span style="color: #c586c0;">in</span> <span style="color: #9cdcfe;">first_column_cells</span>:</div><div> <span style="color: #9cdcfe;">url</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">cell</span>.value</div><div> <span style="color: #6a9955;"># Check if the corresponding cell in the second column is empty</span></div><div> <span style="color: #9cdcfe;">second_column_value</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">sheet</span>.<span style="color: #dcdcaa;">cell</span>(<span style="color: #9cdcfe;">cell</span>.row, <span style="color: #b5cea8;">2</span>).<span style="color: #9cdcfe;">value</span></div><div> <span style="color: #c586c0;">if</span> <span style="color: #569cd6;">not</span> <span style="color: #9cdcfe;">second_column_value</span>:</div><div> <span style="color: #6a9955;"># Get channel details</span></div><div> <span style="color: #9cdcfe;">channel_info</span> <span style="color: #d4d4d4;">=</span> <span style="color: #dcdcaa;">get_channel_info_using_api</span>(<span style="color: #9cdcfe;">url</span>)</div><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">channel_info</span>:</div><div> <span style="color: #9cdcfe;">channel_name</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">channel_info</span>[<span style="color: #ce9178;">"name"</span>]</div><div> <span style="color: #9cdcfe;">channel_id</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">channel_info</span>[<span style="color: #ce9178;">"id"</span>]</div><div> <span style="color: #6a9955;"># Check if a worksheet with the same name already exists</span></div><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">channel_name</span> <span style="color: #569cd6;">in</span> <span style="color: #9cdcfe;">sh</span>.<span style="color: #dcdcaa;">worksheets</span>():</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"Worksheet '</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">channel_name</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">' already available."</span>)</div><div> <span style="color: #c586c0;">else</span>:</div><div> <span style="color: #6a9955;"># Create a new worksheet with the channel name</span></div><div> <span style="color: #9cdcfe;">new_worksheet</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">sh</span>.<span style="color: #dcdcaa;">add_worksheet</span>(<span style="color: #9cdcfe;">title</span><span style="color: #d4d4d4;">=</span><span style="color: #9cdcfe;">channel_name</span>, <span style="color: #9cdcfe;">cols</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"9"</span>, <span style="color: #9cdcfe;">rows</span><span style="color: #d4d4d4;">=</span><span style="color: #ce9178;">"18000"</span>)</div><div> <span style="color: #6a9955;"># Add headers to the new worksheet</span></div><div> <span style="color: #9cdcfe;">headers</span> <span style="color: #d4d4d4;">=</span> [<span style="color: #ce9178;">"Title"</span>, <span style="color: #ce9178;">"Views Earlier"</span>, <span style="color: #ce9178;">"Link"</span>, <span style="color: #ce9178;">"Title"</span>, <span style="color: #ce9178;">"Views Later"</span>, <span style="color: #ce9178;">"Link"</span>]</div><div> <span style="color: #9cdcfe;">new_worksheet</span>.<span style="color: #dcdcaa;">insert_row</span>(<span style="color: #9cdcfe;">headers</span>, <span style="color: #9cdcfe;">index</span><span style="color: #d4d4d4;">=</span><span style="color: #b5cea8;">1</span>)</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"Worksheet '</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">channel_name</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">' created."</span>)</div><br /><div> <span style="color: #6a9955;">#get videos using channel id</span></div><div> <span style="color: #9cdcfe;">videos</span> <span style="color: #d4d4d4;">=</span> <span style="color: #dcdcaa;">get_channel_videos</span>(<span style="color: #9cdcfe;">channel_id</span>)</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"Got the videos of '</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">channel_name</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">'."</span>)</div><br /><div> <span style="color: #6a9955;">#save videos into google sheet</span></div><div> <span style="color: #dcdcaa;">save_to_google_sheets</span>(<span style="color: #9cdcfe;">videos</span>, <span style="color: #9cdcfe;">channel_name</span>, <span style="color: #9cdcfe;">sh</span>)</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"Saved into google shhet:-'</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">channel_name</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">'."</span>)</div><div> <span style="color: #9cdcfe;">sheet</span>.<span style="color: #dcdcaa;">update_cell</span>(<span style="color: #9cdcfe;">cell</span>.row, <span style="color: #b5cea8;">2</span>, <span style="color: #ce9178;">"First Process Done"</span>)</div><br /><div> <span style="color: #6a9955;"># Get current date and time</span></div><div> <span style="color: #9cdcfe;">current_date</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">datetime</span>.<span style="color: #4ec9b0;">datetime</span>.<span style="color: #dcdcaa;">now</span>().<span style="color: #dcdcaa;">strftime</span>(<span style="color: #ce9178;">"</span><span style="color: #569cd6;">%d</span><span style="color: #ce9178;">-%m-%Y"</span>) <span style="color: #6a9955;"># Format date as dd-mm-yyyy</span></div><div> <span style="color: #9cdcfe;">current_time</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">datetime</span>.<span style="color: #4ec9b0;">datetime</span>.<span style="color: #dcdcaa;">now</span>().<span style="color: #dcdcaa;">strftime</span>(<span style="color: #ce9178;">"%H:%M"</span>) <span style="color: #6a9955;"># Format time in 24-hour format</span></div><br /><div> <span style="color: #6a9955;"># Update cells</span></div><div> <span style="color: #9cdcfe;">sheet</span>.<span style="color: #dcdcaa;">update_cell</span>(<span style="color: #9cdcfe;">cell</span>.row, <span style="color: #b5cea8;">3</span>, <span style="color: #9cdcfe;">current_date</span>) <span style="color: #6a9955;"># Updating current date in the third column</span></div><div> <span style="color: #9cdcfe;">sheet</span>.<span style="color: #dcdcaa;">update_cell</span>(<span style="color: #9cdcfe;">cell</span>.row, <span style="color: #b5cea8;">4</span>, <span style="color: #9cdcfe;">current_time</span>) <span style="color: #6a9955;"># Updating current time in the fourth column</span></div><br /><div> <span style="color: #c586c0;">else</span>:</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"Failed to get channel info for URL: </span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">url</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">"</span>)</div><div> <span style="color: #c586c0;">else</span>:</div><div> <span style="color: #6a9955;"># Get channel name from the URL</span></div><div> <span style="color: #9cdcfe;">channel_info</span> <span style="color: #d4d4d4;">=</span> <span style="color: #dcdcaa;">get_channel_info_using_api</span>(<span style="color: #9cdcfe;">url</span>)</div><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">channel_info</span>:</div><div> <span style="color: #9cdcfe;">channel_name</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">channel_info</span>[<span style="color: #ce9178;">"name"</span>]</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"First process already done for channel '</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">channel_name</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">'."</span>)</div><br /><br /><div><span style="color: #6a9955;">#special function to delete 1 row 3 cells and shift them up</span></div><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">delete_and_shift_up</span>(<span style="color: #9cdcfe;">sheet</span>, <span style="color: #9cdcfe;">start_row</span>, <span style="color: #9cdcfe;">start_col</span>, <span style="color: #9cdcfe;">num_rows</span>, <span style="color: #9cdcfe;">num_cols</span>):</div><div> <span style="color: #ce9178;">"""</span></div><div><span style="color: #ce9178;"> Delete cells in the specified range and shift the remaining cells up.</span></div><div><span style="color: #ce9178;"> </span></div><div><span style="color: #ce9178;"> Args:</span></div><div><span style="color: #ce9178;"> - sheet: gspread Worksheet object</span></div><div><span style="color: #ce9178;"> - start_row: int, starting row index</span></div><div><span style="color: #ce9178;"> - start_col: int, starting column index</span></div><div><span style="color: #ce9178;"> - num_rows: int, number of rows to delete</span></div><div><span style="color: #ce9178;"> - num_cols: int, number of columns to delete</span></div><div><span style="color: #ce9178;"> """</span></div><div> <span style="color: #6a9955;"># Get the sheet ID</span></div><div> <span style="color: #9cdcfe;">sheet_id</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">sheet</span>.id</div><br /><div> <span style="color: #6a9955;"># Construct the request to delete the range</span></div><div> <span style="color: #9cdcfe;">delete_request</span> <span style="color: #d4d4d4;">=</span> {</div><div> <span style="color: #ce9178;">"deleteRange"</span>: {</div><div> <span style="color: #ce9178;">"range"</span>: {</div><div> <span style="color: #ce9178;">"sheetId"</span>: <span style="color: #9cdcfe;">sheet_id</span>,</div><div> <span style="color: #ce9178;">"startRowIndex"</span>: <span style="color: #9cdcfe;">start_row</span> <span style="color: #d4d4d4;">-</span> <span style="color: #b5cea8;">1</span>, <span style="color: #6a9955;"># Adjust for 0-based index</span></div><div> <span style="color: #ce9178;">"endRowIndex"</span>: <span style="color: #9cdcfe;">start_row</span> <span style="color: #d4d4d4;">+</span> <span style="color: #9cdcfe;">num_rows</span> <span style="color: #d4d4d4;">-</span> <span style="color: #b5cea8;">1</span>,</div><div> <span style="color: #ce9178;">"startColumnIndex"</span>: <span style="color: #9cdcfe;">start_col</span> <span style="color: #d4d4d4;">-</span> <span style="color: #b5cea8;">1</span>, <span style="color: #6a9955;"># Adjust for 0-based index</span></div><div> <span style="color: #ce9178;">"endColumnIndex"</span>: <span style="color: #9cdcfe;">start_col</span> <span style="color: #d4d4d4;">+</span> <span style="color: #9cdcfe;">num_cols</span> <span style="color: #d4d4d4;">-</span> <span style="color: #b5cea8;">1</span></div><div> },</div><div> <span style="color: #ce9178;">"shiftDimension"</span>: <span style="color: #ce9178;">"ROWS"</span> <span style="color: #6a9955;"># Shift remaining cells up</span></div><div> }</div><div> }</div><br /><div> <span style="color: #6a9955;"># Send the batch update request</span></div><div> <span style="color: #9cdcfe;">sheet</span>.spreadsheet.batch_update({<span style="color: #ce9178;">"requests"</span>: [<span style="color: #9cdcfe;">delete_request</span>]})</div><br /><div><span style="color: #6a9955;">#Function to clear after 24 hours extra videos cells and then use another function to shift up</span></div><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">synchronize_google_sheet</span>(<span style="color: #9cdcfe;">sheet</span>):</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #ce9178;">"Correcting row Start."</span>)</div><div> <span style="color: #6a9955;"># Get the value from the 2nd row, column 3</span></div><div> <span style="color: #9cdcfe;">value_to_match</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">sheet</span>.cell(<span style="color: #b5cea8;">2</span>, <span style="color: #b5cea8;">3</span>).value</div><br /><div> <span style="color: #6a9955;"># Find the matching row number in column 6</span></div><div> <span style="color: #9cdcfe;">matching_row</span> <span style="color: #d4d4d4;">=</span> <span style="color: #569cd6;">None</span></div><div> <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">row</span> <span style="color: #c586c0;">in</span> <span style="color: #4ec9b0;">range</span>(<span style="color: #b5cea8;">1</span>, <span style="color: #9cdcfe;">sheet</span>.row_count <span style="color: #d4d4d4;">+</span> <span style="color: #b5cea8;">1</span>):</div><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">sheet</span>.cell(<span style="color: #9cdcfe;">row</span>, <span style="color: #b5cea8;">6</span>).value <span style="color: #d4d4d4;">==</span> <span style="color: #9cdcfe;">value_to_match</span>:</div><div> <span style="color: #9cdcfe;">matching_row</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">row</span></div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"Match found in row </span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">matching_row</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">."</span>)</div><div> <span style="color: #c586c0;">break</span></div><br /><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">matching_row</span> <span style="color: #569cd6;">is</span> <span style="color: #569cd6;">None</span>:</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #ce9178;">"Value not found in column 6."</span>)</div><div> <span style="color: #c586c0;">return</span></div><br /><div> <span style="color: #6a9955;"># Clear cells in columns 4, 5, and 6 up to the matching row</span></div><div> <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">clear_row</span> <span style="color: #c586c0;">in</span> <span style="color: #4ec9b0;">range</span>(<span style="color: #b5cea8;">2</span>, <span style="color: #9cdcfe;">matching_row</span>):</div><div> <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">col</span> <span style="color: #c586c0;">in</span> <span style="color: #4ec9b0;">range</span>(<span style="color: #b5cea8;">4</span>, <span style="color: #b5cea8;">7</span>):</div><div> <span style="color: #9cdcfe;">sheet</span>.update_cell(<span style="color: #9cdcfe;">clear_row</span>, <span style="color: #9cdcfe;">col</span>, <span style="color: #ce9178;">""</span>)</div><br /><div> <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">i</span> <span style="color: #c586c0;">in</span> <span style="color: #4ec9b0;">range</span> (<span style="color: #9cdcfe;">matching_row</span> <span style="color: #d4d4d4;">-</span> <span style="color: #b5cea8;">2</span>):</div><div> <span style="color: #dcdcaa;">delete_and_shift_up</span>(<span style="color: #9cdcfe;">sheet</span>, <span style="color: #b5cea8;">2</span>, <span style="color: #b5cea8;">4</span>, <span style="color: #b5cea8;">1</span>, <span style="color: #b5cea8;">3</span>)</div><br /><div> <span style="color: #6a9955;"># Apply formula "=ABS(B1-E1)" in whole column 7</span></div><div> <span style="color: #9cdcfe;">formula</span> <span style="color: #d4d4d4;">=</span> <span style="color: #ce9178;">"=ABS(B1-E1)"</span></div><div> <span style="color: #9cdcfe;">range_to_apply</span> <span style="color: #d4d4d4;">=</span> <span style="color: #569cd6;">f</span><span style="color: #ce9178;">"G1:G1"</span> <span style="color: #6a9955;"># Assuming G is column 7</span></div><div> <span style="color: #9cdcfe;">sheet</span>.update(<span style="color: #9cdcfe;">range_to_apply</span>, <span style="color: #9cdcfe;">formula</span>)</div><br /><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #ce9178;">"Updating rows completed."</span>)</div><br /><br /><br /><div><span style="color: #6a9955;">#after 24 hours worksheet update, and all the last function work in this function.</span></div><div><span style="color: #569cd6;">def</span> <span style="color: #dcdcaa;">worksheet_after</span>():</div><div> <span style="color: #6a9955;"># Get all non-empty cells in the first column of Sheet1</span></div><div> <span style="color: #9cdcfe;">first_column_cells</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">sheet</span>.<span style="color: #dcdcaa;">findall</span>(<span style="color: #4ec9b0;">re</span>.<span style="color: #dcdcaa;">compile</span>(<span style="color: #569cd6;">r</span><span style="color: #d16969;">'^https</span><span style="color: #d7ba7d;">?</span><span style="color: #d16969;">://'</span>))</div><div> </div><div> <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">cell</span> <span style="color: #c586c0;">in</span> <span style="color: #9cdcfe;">first_column_cells</span>:</div><div> <span style="color: #9cdcfe;">url</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">cell</span>.value</div><div> <span style="color: #6a9955;"># Check if the corresponding cell in the fifth column is empty</span></div><div> <span style="color: #9cdcfe;">fifth_column_value</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">sheet</span>.<span style="color: #dcdcaa;">cell</span>(<span style="color: #9cdcfe;">cell</span>.row, <span style="color: #b5cea8;">5</span>).<span style="color: #9cdcfe;">value</span></div><div> <span style="color: #c586c0;">if</span> <span style="color: #569cd6;">not</span> <span style="color: #9cdcfe;">fifth_column_value</span>:</div><div> <span style="color: #6a9955;"># Get channel details</span></div><div> <span style="color: #9cdcfe;">channel_info</span> <span style="color: #d4d4d4;">=</span> <span style="color: #dcdcaa;">get_channel_info_using_api</span>(<span style="color: #9cdcfe;">url</span>)</div><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">channel_info</span>:</div><div> <span style="color: #9cdcfe;">channel_name</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">channel_info</span>[<span style="color: #ce9178;">"name"</span>].strip().lower() <span style="color: #6a9955;"># Normalize channel name</span></div><div> <span style="color: #9cdcfe;">channel_id</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">channel_info</span>[<span style="color: #ce9178;">"id"</span>]</div><div> <span style="color: #9cdcfe;">worksheets</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">sh</span>.<span style="color: #dcdcaa;">worksheets</span>()</div><div> <span style="color: #9cdcfe;">worksheet_titles</span> <span style="color: #d4d4d4;">=</span> [<span style="color: #9cdcfe;">worksheet</span>.<span style="color: #9cdcfe;">title</span>.strip().lower() <span style="color: #c586c0;">for</span> <span style="color: #9cdcfe;">worksheet</span> <span style="color: #c586c0;">in</span> <span style="color: #9cdcfe;">worksheets</span>] <span style="color: #6a9955;"># Normalize worksheet titles</span></div><div> <span style="color: #6a9955;"># print(worksheet_titles)</span></div><div> <span style="color: #6a9955;"># Check if a worksheet with the same name already exists</span></div><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">channel_name</span> <span style="color: #569cd6;">in</span> <span style="color: #9cdcfe;">worksheet_titles</span>:</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #9cdcfe;">channel_name</span>)</div><div> <span style="color: #6a9955;"># Get videos using channel id</span></div><div> <span style="color: #9cdcfe;">videos</span> <span style="color: #d4d4d4;">=</span> <span style="color: #dcdcaa;">get_channel_videos</span>(<span style="color: #9cdcfe;">channel_id</span>)</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"Got the videos of '</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">channel_name</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">'."</span>)</div><br /><div> <span style="color: #6a9955;">#save videos into google sheet</span></div><div> <span style="color: #dcdcaa;">save_to_google_sheets_after</span>(<span style="color: #9cdcfe;">videos</span>, <span style="color: #9cdcfe;">channel_name</span>, <span style="color: #9cdcfe;">sh</span>)</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"After data Saved into google shhet:-'</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">channel_name</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">'."</span>)</div><div> </div><div> <span style="color: #6a9955;">#Correct extra row</span></div><div> <span style="color: #dcdcaa;">synchronize_google_sheet</span>(<span style="color: #9cdcfe;">channel_name</span>)</div><br /><div> <span style="color: #9cdcfe;">sheet</span>.<span style="color: #dcdcaa;">update_cell</span>(<span style="color: #9cdcfe;">cell</span>.row, <span style="color: #b5cea8;">5</span>, <span style="color: #ce9178;">"24 hours Process Done"</span>)</div><br /><br /><div> <span style="color: #6a9955;"># Get current date and time</span></div><div> <span style="color: #9cdcfe;">current_date</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">datetime</span>.<span style="color: #4ec9b0;">datetime</span>.<span style="color: #dcdcaa;">now</span>().<span style="color: #dcdcaa;">strftime</span>(<span style="color: #ce9178;">"</span><span style="color: #569cd6;">%d</span><span style="color: #ce9178;">-%m-%Y"</span>) <span style="color: #6a9955;"># Format date as dd-mm-yyyy</span></div><div> <span style="color: #9cdcfe;">current_time</span> <span style="color: #d4d4d4;">=</span> <span style="color: #4ec9b0;">datetime</span>.<span style="color: #4ec9b0;">datetime</span>.<span style="color: #dcdcaa;">now</span>().<span style="color: #dcdcaa;">strftime</span>(<span style="color: #ce9178;">"%H:%M"</span>) <span style="color: #6a9955;"># Format time in 24-hour format</span></div><br /><div> <span style="color: #6a9955;"># Update cells</span></div><div> <span style="color: #9cdcfe;">sheet</span>.<span style="color: #dcdcaa;">update_cell</span>(<span style="color: #9cdcfe;">cell</span>.row, <span style="color: #b5cea8;">6</span>, <span style="color: #9cdcfe;">current_date</span>) <span style="color: #6a9955;"># Updating current date in the third column</span></div><div> <span style="color: #9cdcfe;">sheet</span>.<span style="color: #dcdcaa;">update_cell</span>(<span style="color: #9cdcfe;">cell</span>.row, <span style="color: #b5cea8;">7</span>, <span style="color: #9cdcfe;">current_time</span>) <span style="color: #6a9955;"># Updating current time in the fourth column</span></div><br /><div> <span style="color: #c586c0;">else</span>:</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"Failed to get channel info for URL: </span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">url</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">"</span>)</div><div> <span style="color: #c586c0;">else</span>:</div><div> <span style="color: #6a9955;"># Get channel name from the URL</span></div><div> <span style="color: #9cdcfe;">channel_info</span> <span style="color: #d4d4d4;">=</span> <span style="color: #dcdcaa;">get_channel_info_using_api</span>(<span style="color: #9cdcfe;">url</span>)</div><div> <span style="color: #c586c0;">if</span> <span style="color: #9cdcfe;">channel_info</span>:</div><div> <span style="color: #9cdcfe;">channel_name</span> <span style="color: #d4d4d4;">=</span> <span style="color: #9cdcfe;">channel_info</span>[<span style="color: #ce9178;">"name"</span>]</div><div> <span style="color: #dcdcaa;">print</span>(<span style="color: #569cd6;">f</span><span style="color: #ce9178;">"24 hours process already done for channel '</span><span style="color: #569cd6;">{</span><span style="color: #9cdcfe;">channel_name</span><span style="color: #569cd6;">}</span><span style="color: #ce9178;">'."</span>)</div><br /><br /><br /><div><span style="color: #dcdcaa;">create_worksheet_for_channel</span>()</div><div><span style="color: #6a9955;"># print("first process complete---------------------")</span></div><div><span style="color: #dcdcaa;">worksheet_after</span>()</div><br /><br /><br /></div>

Youtube channel keywords extractor. get channel link from sheet and creating new sheet for channels.

  import re import gspread import datetime from googleapiclient . discovery import build import time as tm sa = gspread . service...

Read more »