DEV Community

Cover image for I created a GitHub Clone Using JavaScript - WebScrapperJS ๐Ÿ˜ฎ
Sh Raj
Sh Raj

Posted on

I created a GitHub Clone Using JavaScript - WebScrapperJS ๐Ÿ˜ฎ

See Demo :- https://jscloneof.github.io/


Demo

Home View :- https://jscloneof.github.io/

Image description

User Page View :- https://jscloneof.github.io/sh20raj

Image description

Repo Page

Repo View :- https://jscloneof.github.io/sh20raj/SopCss

Image description

Image description


The Process


Tools to be Used :-

WebScrapperJS - Get Content/HTML of any website without being blocked by CORS even using JavaScript by WhollyAPI
Detailed Article

GitHub logo SH20RAJ / WebScrapperJS

WebScrapperJS - Get Content/HTML of any website without being blocked by CORS even using JavaScript by WhollyAPI

WebScrapperJS

WebScrapperJS - Get Content/HTML of any website without being blocked by CORS even using JavaScript by WhollyAPI


Website :- https://sh20raj.github.io/WebScrapperJS/

GitHub | Repl.it | Dev.to Article


Grab the CDN or Download the JavaScript File

<script src="https://cdn.jsdelivr.net/gh/SH20RAJ/WebScrapperJS/WebScrapper.js" ></script>
Enter fullscreen mode Exit fullscreen mode

  • WebScrapper.get() will return you the content of the provided url in a String.

  • WebScrapper.gethtml() will return you the content of the provided url as Parsed DOM. ( Will get the html and Parse it as a DOM object . Will return you a #Document)

  • WebScrapper.getjson() will return you the content of the provided url as Parsed JSON.


To Get HTML/Text/Content of Any Website in a String.

var html = WebScrapper.get('https://webscrapperjs.sh20raj.repl.co/');//This will be return the HTML/Text inside the webpage in a String.
console.log(html);
Enter fullscreen mode Exit fullscreen mode

This will be return the HTML/Text inside the webpage inโ€ฆ


I noticed that GitHub pages has a special feature that it can redirect your invalid URLs 404 not found to 404.html by default without using .htaccess.

So, because .htaccess is not supported in Simple JavaScript and html project. This clue matters a lot to me.

And Recently I had created a tool to Get Content/HTML of any website without being blocked by CORS even using JavaScript by WhollyAPI named WebScrapperJS .

And after searching my username on google.

I found these URLs

They was just blindly cloning github.com using any backend language and showing the copy.

So, I also decided to do that but on GitHub Pages (The Good Part) you can see the demo here. https://jscloneof.github.io/

The Repo May contain only one file and work fluently. 404.html


The Full Code That is needed

<div id="body"></div>
<script src="https://cdn.jsdelivr.net/gh/SH20RAJ/WebScrapperJS/WebScrapper.min.js" ></script>
<script>
  var url = "https://github.com"+location.pathname+''+location.search;
  document.write(WebScrapper.get(url)) ;
</script>
Enter fullscreen mode Exit fullscreen mode

Visit GitHub

GitHub logo jscloneof / jscloneof.github.io

Clone of GitHub Created Using JavaScript ft. WhollyAPI & WebScrapperJS

# jscloneof.github.io
Clone of GitHub Created Using JavaScript ft. WhollyAPI & WebScrapperJS

---

## GitHub :- https://github.com/jscloneof/jscloneof.github.io

## Demo :- https://jscloneof.github.io/

## Article :- https://dev.to/sh20raj/i-created-a-github-clone-using-javascript-webscrapperjs-3pn0

## Deploy on Vercel :- ![https://vercel.com/button](https://vercel.com/new/clone?repository-url=https://github.com/jscloneof/jscloneof.github.io)

main.js File 
```javascript
  var url = "https://github.com"+location.pathname+''+location.search;
  document.write(WebScrapper.get(url)) ;
  
  function getparam(a,e){return e||(e=window.location.href),new URL(e).searchParams.get(a)}
  ```

Bonus :-

Deploy on Vercel

Deploy with Vercel

Follow Me

Top comments (0)