ditch Google!! (build your own PRIVATE search engine) - YouTube

Channel: NetworkChuck

[0]
You need to build your own search engine, your own Google, your,
[2]
your own being because Hey,
[4]
your privacy is at risk companies like Google and Microsoft.
[7]
They know everything about you.
[9]
So it learns information about me seems like an invasion of privacy.
[14]
Every time you search for anything,
[15]
Google and Microsoft build a profile information about you.
[19]
And then they sell it to advertisers. Jerks,
[23]
leaving you with no privacy, but you might be thinking, Hey Chuck,
[26]
what about incognito mode? Nope, doesn't work, but wait, what about duck dot go?
[30]
They're pretty private, right? No,
[32]
they've got this weird relationship with Microsoft.
[33]
So the best way to ensure your privacy,
[35]
your anonymity necessarily the right anonymity,
[38]
anonymity online is to build your own search engine, your own Google,
[42]
which might sound like overkill, but it's not too crazy. Actually.
[45]
It's actually kind of easy. You'll be able to do it here in about 10 minutes.
[48]
And it's awesome.
[49]
Like you could say you have your own search engine and you'll have complete
[52]
control over it. Complete privacy.
[54]
Now I'm building my search engine in the cloud, which is super quick and easy.
[57]
Thanks to our sponsor Leno, but you don't have to do that.
[60]
You can literally build this on anything, a spare computer in your house. A, um,
[64]
oh, I know I had one around here, somewhere,
[67]
a raspberry pie or even the computer you're using right now. So yeah,
[70]
you can install it anywhere cuz we're using Docker. You'll see. You'll see.
[73]
And before you're like, ah, Chuck, this is so stupid. I don't wanna do this.
[76]
Hear me out. Try it for yourself. I've already built it. Actually.
[79]
It's already up in the cloud. You can use my Google that I built.
[82]
So check it out. Link below search.network, chuck.coffee.
[85]
I can promise you this. It'll give you more privacy than Google or Microsoft,
[88]
but it's not the ultimate privacy option.
[90]
The only way you're gonna get the ultimate privacy is by doing it yourself,
[94]
having it on your own stuff. So let's do that right now. Now before we start,
[98]
what do you need to do this? And what are we even doing right now?
[100]
<laugh> well first lemme, lemme tell you this.
[102]
We're deploying something called seas. Think it's like say it, seas circs.
[106]
And more specifically we're deploying CIS NNG,
[108]
which is a fork of the original sea.
[110]
Essentially what it is is a Maita search engine,
[112]
which all that means is that it uses Google Bing or whatever other search engine
[116]
you want to use. It uses all of those, everything everywhere all at once.
[119]
I just watched that kind of it's pretty good. So far.
[121]
Now there are other search engines that do this,
[123]
but the difference here is that this is your search engine,
[125]
your own private one now se search. However you say it. It's awesome.
[128]
It's open source and their goal is to protect everyone's privacy.
[131]
We'll talk more about how that works here in a moment, but first,
[134]
what do you need to be able to build this?
[135]
The great news is that you don't need much.
[137]
All you need is a computer or a server that can have Docker installed,
[140]
which is pretty much anything. If you're using windows, Mac, or Linux,
[143]
you can install Docker. Now I'm not gonna cover that here in this video,
[146]
but I do have other videos showing you how to do all that stuff.
[148]
So check him out here below or up here and below there I'm I need more coffee.
[153]
And if the word Docker scares you, don't worry. I'll walk you through.
[156]
It's actually ridiculously easy and super powerful. I, I love it so much.
[160]
Like I can't wait to show you and second you're gonna need, I actually,
[164]
you don't need, this is optional, but you'll want a domain name. So for example,
[166]
mine is search.network. chuck.coffee.
[168]
You'll want something pretty to do that with you don't have to, but you can.
[171]
And finally,
[172]
the most important thing on this list you'll need some coffee because everything
[175]
in it, it requires coffee. Did you know that it does now for this tutorial,
[180]
I'm going to install Docker on a Linux server in the cloud.
[182]
I'll walk you through every step. And for most situations,
[184]
this will be the instructions for whatever you're working on. So don't think,
[187]
oh, he's in the cloud. I can't follow this tutorial. No,
[189]
it'll it'll work pretty much wherever you are. Now. As I mentioned before,
[191]
this tutorial's gonna be like really fast.
[193]
It'll take you about five minutes to do this.
[195]
So I've gotta fill the time in this video with something.
[197]
So let me explain how sea works real quick, which you don't,
[199]
you don't wanna skip this. You gotta know how your privacy is being protected.
[202]
So why is sea awesome? And I feel like I'm saying that wrong CISs. I don't know.
[206]
There's no way around it. The first thing it does. And I,
[208]
I love this whenever you search for anything, for example, coffee,
[211]
as you do on the daily, we know that sea is a made a search engine.
[214]
So when you search for coffee, it's gonna go, Hey, Google, what you got? Hey,
[217]
Bing, what you got? Hey, duck, duck go. What you got? Which so far,
[221]
this seems kind of like not different from anything else because you're
[224]
thinking, well, Google's gonna know I'm searching for coffee.
[226]
Bing's gonna know I'm searching for coffee.
[228]
Duck do go is gonna know I'm searching for coffee. They know it's network.
[230]
Chuck I'm exposed. No, no, here's what,
[232]
here's what CX does for every single search.
[235]
It builds a random search profile, a profile that has nothing to do with you.
[240]
They don't know who you are. They don't know your interest.
[242]
They don't know anything.
[243]
All they know is this random new profile of searching for coffee.
[246]
And that happens every single time you search for something. Whereas, you know,
[250]
Google or Bing, they've got a history of all the things you're searching for.
[253]
They know who you are. You like coffee and you like Marvel. That's who you are.
[256]
They're gonna give you ads for coffee and Marvel Marvel coffee mugs.
[259]
That'd be pretty cool. I want one.
[260]
I'm probably get an add for one here in a moment. Yep. There it is.
[263]
So that's the first thing they do is they just generate a private profile for
[266]
you. Every time you search every single stink and search.
[268]
Guess what else it does. It's so cool. Do you like ads? I mean,
[272]
you should watch ads in this video. That's the only time I condone ads,
[275]
but with this no ads, Bing, Google, duck dot go, or you know, search itself.
[280]
Cause it's your browser. They're not gonna serve you. Ads,
[282]
no ads coming back at you. Then finally, number three,
[284]
what they do here is when you do search for coffee and Google obviously is gonna
[287]
tell you network chuck.coffee. That's obvious, normally private data about you.
[292]
Your profile will be shared with that resulting website.
[295]
That resulting page that you're looking for, not here, not with C.
[298]
And then there is one more added benefit. If you install us on a cloud server,
[301]
like we're about to do on Le node and it's this normally when you're searching
[304]
for something, they know your IP address, that's just how the internet works.
[306]
So right now, if I were to Google for my computer,
[308]
they would know my home IP address,
[310]
which does tell the internet something about you like where you live, go.
[313]
To Google earth and type in your address.
[319]
And a bunch of other stuff. And also your ISP and whoever you use for DNS.
[323]
They know things about you, but if you have a server in the cloud,
[325]
you're deploying this on, Hey, it has its own public IP.
[329]
And when you search for anything websites, Google,
[331]
Bing are gonna see that IP address,
[333]
which does not tell anyone where you live or really much about you.
[336]
Now that's a super, super high level overview coffee break.
[340]
If you want a deeper dive, which I,
[341]
I went down this rabbit hole a bit and to understanding how these search engines
[344]
are made and how they work. It's kind of crazy. I'll put links below,
[347]
but they've got a BKU amount of documentation showing you exactly what things
[351]
do. And actually one thing they touch on, which I did not touch on just yet.
[354]
And not saying, what are the consequences of using a public instance?
[357]
What does that mean? Well, for example,
[358]
if you're gonna use my search engine search.network, chuck.coffee. Yes,
[362]
it is pretty private and pretty secure, but I do have control over it.
[366]
So if I chose to, I could look at some logs.
[368]
I could have some data that would tell me some things about you.
[371]
I'm not going to, but I could.
[372]
And when it comes to the internet and computers with anything you're doing,
[375]
don't trust anything don't trust, anyone don't trust any company.
[378]
The only thing you can trust is, well person is you. Unless you're a thing,
[382]
check the box. If you're not a robot, that's the only person you can trust.
[385]
So build your own.
[385]
Now this is also talking about is you can build out a public instance like I'm
[389]
doing, you can make your search engine available to your friends or your family,
[392]
whoever you want to, or you can just make a private instance.
[395]
That's only available on your land.
[397]
And as long as that thing has internet access, you're good. So for a lot of you,
[400]
this might be what you want to do.
[401]
Just have your own private search engine on your computer or on a server on your
[405]
computer, on your nest, whatever you wanna do anyways,
[406]
back to the geekiness of this. You can look at all the documentation.
[409]
You can look at the architecture and all the crazy fun stuff it does,
[412]
but enough talking about it, time to actually build this,
[414]
which is gonna take about five minutes again. So coffee break,
[417]
we gotta fuel up and let's do this.
[420]
First thing we gotta do is build out our cloud server. <laugh> in the cloud.
[424]
Why am I struggling with that?
[425]
I'm gonna navigate out to my favorite cloud provider. Lek.
[427]
You can do that too right now,
[428]
by going out to Le node.com for slash network Chuck and you can magically spin
[432]
up a server within seconds. Like I'm gonna do right now. Create Le node.
[436]
I'm going to do Ubuntu, uh, 20. No, no, 2004.
[441]
Nice and sturdy. Put it close to me. I'm in Dallas.
[443]
Choose how big I want it to be Le node five bucks a month. That's stinking it,
[447]
man. And then I'll name this sucker and put a password in and click on create.
[451]
That's it. Let that sucker bake three 50 for five minutes. No, I'm just kidding.
[455]
I'll be done in like three seconds, but coffee break in the meantime,
[457]
you gotta be quick though. All right, mine is done. Baking,
[460]
gonna grab my SSH access over here. Copy that sucker launch my command prompt,
[465]
CMD paste the command and get logged in or in a best practice. Real quick.
[469]
Let's do a update,
[470]
pseudo PT update to update our repositories and then we'll do an upgrade
[474]
pseudo P T upgrade. And we'll tell it yes. Do everything all at once everywhere.
[479]
Go and again, coffee break. This might take a moment.
[480]
You don't have to upgrade by the way, but it's just best practice.
[482]
Wanna make sure everything works right. And it's safe and secure. You do. Yeah,
[486]
you do. Whew. That took like two minutes. I was, I'm just impatient,
[489]
but it's done now. So we have our server. We have it updated. Now.
[492]
Time to install my favorite thing in the whole world right now,
[494]
it really is Docker. Don't know what Docker is.
[497]
I'm not gonna tell you right now,
[498]
but I do have a video where I already told you. So check it out. Anyways,
[501]
here we go to install Docker. We'll do pseudo P T install, docker.io.
[506]
Now this should work for most people. Just putting that caveat there.
[509]
Then I'll do a space dash Y and let it do its thing done. Okay.
[513]
Now we're gonna install one more thing.
[515]
We're gonna install something called Docker compose,
[517]
which allows us to do so many Dockers all at once. It's so great. Anyways,
[521]
those should install it. I'll show you so pseudo a P T install,
[525]
Docker dash compose, do a dash wide at the end and this should be fairly quick.
[529]
Okay. Everything is installed. Now. Time to let's let's do the search thing.
[532]
Okay, here we go. And actually at this point,
[534]
what you may wanna do is go get a domain name. If you don't already have one.
[537]
Now, if you're running this at home, inside your network,
[539]
I'm not gonna show you how to do that.
[541]
But if you're running Le node with a public IP address,
[543]
we can do that real quick. So choose your favorite domain provider. Ooh,
[547]
I like this one. <laugh> not google.live. And once you have your domain name,
[551]
all you'll do is point the, a record at your public IP address for ode.
[554]
So I'll grab that IP address by the way.
[556]
This is not a tutorial on how to set this up. So I'll point it at my IP address,
[559]
click on save. And that part is done. Now. Time to build out CIS CISs, CIS,
[564]
it feels weird now saying it.
[565]
First thing I'll do is navigate to a folder where I wanna keep this thing.
[567]
You can do the same thing or just stay where you are.
[569]
I'm gonna go to CD for slash user slash local bam.
[574]
I'm there. Now we're gonna download CIS CIS. I'm gonna pace this command.
[577]
All these commands will be below by the way, a full guide,
[580]
a full walkthrough and keeping in mind, I'm also using get clone.
[583]
If you don't have GI, you should get it. Sorry for that. Um, just a PT install.
[588]
GI. This is one of those essential tools you just gotta have.
[591]
And when I hit enter, it's gonna be done. Like that was it. <laugh> okay, cool.
[595]
If I type in LS, I'll see. I have a new folder right here.
[598]
CIS and G slash or dash Docker. Let's go ahead and jump in there. CD CIS Docker.
[603]
I'm there. Now we are almost done.
[605]
Just a few things we have to do to get things ready to go here. In this folder.
[608]
If we do LS, we got a few files. There is one hidden and one we wanna edit.
[612]
So I'll type in L L to see all my head stuff. And this guy right here,
[616]
the dot E NV file, let's edit him. So we'll type in nano dot E NV.
[621]
And here we're gonna change just a few things. If you are using a domain,
[624]
you'll put that sucker right there. And then for the let's encrypt certificate,
[629]
it's gonna generate a certificate for you.
[630]
So you actually have SSL on your search engine, which is super cool.
[633]
You're gonna put in your email address. So I'll do that right now.
[635]
I'll make sure I comment out or UN comment out this information,
[639]
put in my new address, not google.live and my email address,
[644]
just like that. Control X Y enter to save, and then we're gonna run just, well,
[649]
a couple more commands, but <laugh> just copy and paste this one real quick.
[652]
This is gonna generate a super secret key for you,
[655]
and it's gonna throw it into your settings folder done. So just do that.
[658]
And now I'm gonna clear my screen, cuz this is,
[659]
this is my favorite part of the whole process. If you type in LS,
[662]
you'll see that right here. I, I have to explain, I can't help myself.
[665]
We have a Docker compose YAML file inside that file.
[668]
It's telling Docker how to build our circs environment.
[671]
It's actually gonna build out three Docker containers,
[673]
connect them together and make it work like magic.
[676]
And all you have to do is type in one command like this one, check it out,
[679]
pseudo type it with me, pseudo Docker dash compose.
[684]
Just make sure you are in this current directory with your Docker compose YAML
[687]
file. And all we have to do is do up and then we'll do, uh,
[691]
dash D to make it a Damon. So it runs in the background. Ready? Set, go
[697]
look at all this. It's downloading the Docker containers.
[700]
It's getting them ready. It's doing it. Ugh. This magic is so cool.
[704]
And that's it. It's done. <laugh> like, that was it. Um,
[708]
you can see your running containers by doing this pseudo Docker PS.
[712]
And I can see right here, I've got three containers, caddy, CIS,
[716]
and Reddis all essential components to make this thing awesome.
[719]
Now at this point, I could actually go check it out. You wanna go check it out?
[723]
Let's go check it out. Not google.live.
[725]
There it is my own stinking search.
[728]
Let's search for coffee and just like that. Safe, secure,
[732]
searching private notice how, when I did search for coffee right here,
[736]
there's all the sources. Wikipedia, brave Wiki data, duck dot go,
[739]
whatever quant is. I don't know what that is down here. We have everything in,
[743]
in Google and it's our own private server. By the way,
[745]
if you want to use not google.live, go for it. In fact, make that the main one,
[748]
not google.live. You can use that however you want.
[751]
I promise I won't track you too much. Although I do talk a lot about hacking.
[754]
So I, I take that with a grain of salt. Now,
[756]
as far as getting this up and running and having it work great, that's it,
[759]
there are a few tweaks that I wanna show you real quick. Um,
[762]
but first for you home lab users who may not be deploying this on a server in
[766]
the cloud,
[766]
I went ahead and deploy this on a virtual machine here on my computer.
[770]
This one right here, it's running on Kelly Lennox.
[772]
And if you didn't change the environment file. So actually,
[775]
if I look at that nano dot E NV, I didn't change it. It's default commented out,
[779]
which means it's by default gonna use local host so I can launch my browser,
[782]
go to local hosts kicks. I dunno know why I said that local host bam.
[787]
So right here, even if I'm not using a another machine or a cloud server,
[791]
I can use it right here on my local machine and search. Now keeping in mind,
[793]
it's gonna use my IP address. So that part is not private or secure. Uh,
[797]
but everything else is all the benefits of CIS works like a charm. Love it.
[801]
Now just a couple of things. Uh, getting back to our server here.
[803]
If I wanna tear down those machines like right now, I've got pseudo Docker, PS,
[808]
I've got three Docker containers running. I can run pseudo Docker,
[813]
compose down, down, boy, that's all we gotta do.
[816]
And it tears it down so you can actually tear it down,
[818]
make some changes and then put it back up. Now what's cool about Docker man.
[822]
I'm I'm the biggest fan is every time you bring it back up,
[824]
it should update the Docker containers to the latest versions available out
[827]
there on the interwebs.
[829]
So you are always being up to date as long as you bring it down and bring it
[831]
back up. Now, a few things we may wanna change. Uh, if I do LL,
[834]
I can see there is a CI NG folder. I'm gonna jump in there, CDs, NG.
[840]
And if I LLL or LS in there, I've got settings dot YAML or YML.
[844]
This right here is a file that you can pretty much control everything in your
[848]
browser with everything. So let's edit it real quick.
[851]
Pseudo nano settings dot YML. Right now, it's pretty bare.
[856]
It's using a lot of default settings, which for most people,
[858]
this will be a okay fine. But if you look at their documentation,
[862]
look at all the stuff you can change with settings that YML,
[864]
I mean just a ton of things, a few things I wanna change right now,
[867]
actually let me show you, let me actually spin up my server once more.
[869]
And this is kind of annoying. I get back into my main folder with the Y uh, the,
[872]
uh, composed file. Bring that sucker up.
[875]
They actually have a pretty amazing support group, which helped me out a ton.
[878]
So if I go to not Google that live search for coffee with extra ease,
[881]
apparently I'll jump into one of the options here. Cool. Totally works.
[884]
But now if I go back, Ooh, Ugh, gross. I don't like that at all.
[887]
This happens because by default they use a post method HTTP method,
[892]
which doesn't play nice with some things.
[893]
So what we can do is actually change the method to get,
[896]
so we'll do that here in our settings as well. So yeah, it's uh,
[899]
you can just do back or refresh it. It's not a big deal,
[901]
but it's very jarring and I hate it. So I'm bring my stuff down once more,
[904]
then I'll edit that file.
[904]
So the first thing I'll change is that pesky method I'll do that right under
[908]
here, under these server options. Ah, keeping in mind, this is a YAML file.
[912]
So you'll need YAML format making it look nice and pretty. If you're like,
[915]
I don't know. It's okay. Just copy the spacing.
[917]
Just make sure it looks exactly like the, the examples here.
[919]
I'll do method and I'll do colon and specify. Get that should change that.
[924]
So actually let me just do a control X, Y enter to save, bring back up my stuff,
[929]
which it's so cool. How fast that is. My gosh. Did you see that? I'll uh,
[932]
refresh it here. Search for coffee. Let's make sure this works.
[935]
Let's jump into one. Then go back. Totally works. No more weird issues. Awesome.
[940]
Now I'm not gonna go over every single change you can make because that'd take
[942]
three years, but I'll show you some fun ones. Like, let me grab some here.
[945]
You can add a general section general section. You can change your instance,
[949]
name to network, Chuck search. You can enable metrics,
[952]
which I'll show you how that works here in a bit.
[954]
And then you can also control like safe search and things like that. So, um,
[957]
let me grab that. This is great for my kids. So here under the search section,
[960]
I enabled strict safe search, which is option two.
[963]
You can also do auto complete and you can specify which auto complete engine to
[966]
use. I'm gonna use duck dot go. That doesn't mean I'm losing any privacy,
[969]
but anyways, let's, uh,
[971]
save that sucker control X Y enter to save and actually notice my stuff is still
[974]
up. So I'm gonna bring it down, down and back up. Notice how off the top here.
[979]
It says network network. I can't talk network check, search at the top.
[983]
And when I start searching for network,
[986]
Chuck auto complete. So cool. So anyways,
[990]
this is your search engine. This is your baby. This is yours.
[993]
And you can share it with anybody or you don't wanna share it with anyone.
[996]
It's your own private thing. Do whatever you wanna do with it.
[998]
Now there's other things you can do that are pretty crazy at this.
[1000]
Now by default,
[1001]
this thing CIS supports over 70 search engines,
[1005]
which you can also enable or disable. You can say, no,
[1008]
I don't wanna use Google and taking that away. You can also add SQL servers.
[1011]
You can also add your own databases that are searchable.
[1014]
So you can add a local instance of let's say my SQL and it will search that.
[1018]
How cool is that?
[1019]
And then if you're like really paranoid and you wanna be super, super,
[1022]
super private,
[1023]
you can also add some proxies for every search you can add proxies.
[1027]
You can add tour, you can do all that stuff,
[1029]
which they have documentation for that. I'm not gonna cover that in this video,
[1032]
cuz that'll make this video way too long, which is probably already too long.
[1034]
Cause I've been talking too much coffee. Well, forgot to show you the stats. Um,
[1038]
I can click on engine stats here at the bottom.
[1040]
It's just four slash stats right now.
[1042]
There's no data available cause I haven't done anything yet. But if I did,
[1045]
it would show you stats about searches and stuff. Pretty cool. Oh.
[1047]
And they also have some like APIs and, and just, oh, this thing is cool.
[1051]
It gives you like, if you're a home lab or just a geek or it,
[1054]
or you're a person you'll love this cuz you can do so much with it.
[1058]
It's kind of API. That's just cool. Right? Anyways. That's all I have.
[1061]
I wanted to show you something cool. I think that can protect your privacy.
[1064]
And it's just a fun project to do it. Didn't take very long.
[1067]
You can do it on the computer using right now and using Docker and Docker
[1069]
compose. And you can essentially make a,
[1071]
a search engine for your friends and your family to make you safe and secure.
[1075]
Don't let Google know what you're searching. It might be weird. And even,
[1077]
even if it's not weird,
[1078]
you don't want Google to know that you don't wanna be a product they're selling.
[1081]
I, I don't know if you've done this, but have you hacked YouTube today?
[1084]
Have you hacked YouTube algorithm?
[1085]
Let's make sure you do hit that like button notification, bell comment,
[1088]
subscribe, uh, that I think that's everything.
[1091]
Just do all the stuff because you gotta hack YouTube today. Ethically of course.
[1097]
And that's all I have. I will catch you guys next time.