Skip to content

nyxragon/Cyber-Info-Webscrapper

Repository files navigation

   ______      __                 ____      ____    
  / ____/_  __/ /_  ___  _____   /  _/___  / __/___ 
 / /   / / / / __ \/ _ \/ ___/   / // __ \/ /_/ __ \
/ /___/ /_/ / /_/ /  __/ /     _/ // / / / __/ /_/ /
\____/\__, /_.___/\___/_/     /___/_/ /_/_/  \____/ 
     /____/                                         

BOT LINK: https://t.me/CyberInf0_bot

WORKING OF THE BOT

Help Menu:

Displays the commands which can be executed on the bot ezgif-2-609b638928

Following data can be scraped using Cyber Info:

1) Cybersecurity News:

Top Headlines are scraped daily from https://cybernews.com/news/
Then from the individual news-links description and cover-image is grabed, all this data is organised in a presentable form and displayed to the user. News

2) CTF-TimeTable

Screenshot of TimeTable of Capture the flag events is scraped monthly from www.ctftime.org.
Selenium Webdriver is used for this purpose. TimeTable

3) CTF-Websites

Data of top websites to play CTFs is scraped and the list is displayed to the user. ctf-websites

4) Cybersecurity Youtube Channels

Data of Cybersecurity YouTube channels is scrapped containing the channel name, frequent topics posted on channel and the channel link, all this data is organised in presentable form and displayed to the user. Channels

5) Cybersecurity Experts on Twitter

Profile links of Top Cybersecurity Experts on Twitter is scaped and the list is displayed to the user. Experts

NOTE: The data is not scraped for each request as too many requests may cause unintentional Denial of Servive (DoS) Attack on the sites.
The sites are scraped periodically and the scraped data is stored in files(Cyber-Info v1 later versions may use databases).
Example: for CTF-TimeTable the bot scraps the site monthly and stores the new time-table for each month,
for news the bot scraps the site once in a day and stores the news of each new day.

About

A web scraping bot that scraps various data such as cyber-news, capture the flag (CTF)- calendar, capture the flag (CTF)-websites, top cyber experts on Twitter and youtube.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages