Erreur32 / tips_httpd.conf_spiders.md
Последняя активность 1 month ago
| 1 | # To relieve servers |
| 2 | |
| 3 | ##Imagine a robots.txt file like this (Google understands this format): |
| 4 | #User-agent: * |
| 5 | #Disallow: /detailed |
| 6 | #Disallow: /?action=detailed |
| 7 | #Disallow: /*/detailed |
| 8 | #Crawl-delay: 20 |
| 9 | ## |
Erreur32 / Web Scraping.md
Последняя активность 1 month ago
Have you ever wanted to get a specific data from another website but there's no API available for it? That's where Web Scraping comes in, if the data is not made available by the website we can just scrape it from the website itself.
But before we dive in let us first define what web scraping is. According to Wikipedia:
{% blockquote %} Web scraping (web harvesting or web data extraction) is a computer software technique of extracting information from websites. Usually, such software programs simulate human exploration of the World Wide Web by either implementing low-level Hypertext Transfer Protocol (HTTP), or embedding a fully-fledged web browser, such as Internet Explorer or Mozilla Firefox. {% endblockquote %}
Erreur32 / Docs_Local_https_certificate.md
Последняя активность 1 month ago
How to create an HTTPS certificate for localhost domains
This focuses on generating the certificates for loading local virtual hosts hosted on your computer, for development only.
Do not use self-signed certificates in production ! For online certificates, use Let's Encrypt instead (tutorial).