{"id":11829,"date":"2022-02-10T15:04:06","date_gmt":"2022-02-10T15:04:06","guid":{"rendered":"https:\/\/mailinvest.blog\/index.php\/2022\/02\/10\/what-is-the-interplanetary-file-system-ipfs-and-how-do-you-use-it\/"},"modified":"2022-02-10T15:04:06","modified_gmt":"2022-02-10T15:04:06","slug":"what-is-the-interplanetary-file-system-ipfs-and-how-do-you-use-it","status":"publish","type":"post","link":"https:\/\/mailinvest.blog\/index.php\/2022\/02\/10\/what-is-the-interplanetary-file-system-ipfs-and-how-do-you-use-it\/","title":{"rendered":"What Is the Interplanetary File System (IPFS) and How Do You Use It?"},"content":{"rendered":"

<\/a>\n<\/p>\n

\n
\"Several
Andrii Yalanskyi \/ Shutterstock<\/a><\/span><\/figcaption><\/figure>\n

The Interplanetary File System (IPFS)<\/a> is a distributed, peer-to-peer file-sharing network that is well-positioned to become the underpinning of a new, decentralized web. Here\u2019s how it works, and how you can start using it.<\/p>\n

A Decentralized Internet<\/h2>\n

Even though it is global, the world wide web<\/a> is still a\u00a0centralized<\/em>\u00a0network. The data storage behind the internet is predominantly servers\u2014physical or virtual\u2014in massive server farms or cloud platforms<\/a>. These facilities are owned by a single company. The servers are owned or rented by other companies and configured and exposed to be accessible to the outside world.<\/p>\n

Anyone wanting to access the information on those servers must make an HTTPS connection<\/a> from their browser to the appropriate server. The server is at the center, serving all the requests for access to the data that it holds.<\/p>\n

This is a simplification of course, but it does describe the general model. To allow for scaling and to provide robustness, organizations can bring mirror servers and content delivery networks<\/a> into play. But even then, there\u2019s still a relatively small and finite number of locations that people can go to in order to access those files.<\/p>\n

IPFS is an implementation of a\u00a0decentralized<\/em>\u00a0network. One of the most popular decentralized systems is Git<\/a>, the version control software. Git is a distributed system because every developer who has cloned a repository has a copy of the entire repository, including the history, on their computer. If the central repository is wiped out, any copy of the repository can be used to restore it. IPFS takes that distributed concept and applies it to file storage and data retrieval.<\/p>\n

IPFS was created by Juan Benet and is maintained by Protocol Labs<\/a>, the company he founded. They took the decentralized nature of Git and the distributed, bandwidth-saving techniques of torrents and created a filing system that works across all of the nodes in the IPFS network. And it\u2019s here now, and working.<\/p>\n

How the IPFS Works<\/h2>\n

The IPFS decentralized web is made up of all the computers connected to it, known as nodes<\/em>. Nodes can store data and make it accessible to anyone who requests it.<\/p>\n

If someone requests a file<\/a> or a webpage, a copy of the file is cached on their node. As more and more people request that data, more and more cached copies will exist. Subsequent requests for that file can be fulfilled by any node\u2014or combination of nodes\u2014that has the file on it. The burden of delivering the data and fulfilling the request is gradually shared out amongst many nodes.<\/p>\n

This calls for a new type of web address. Instead of\u00a0address-based<\/em>\u00a0routing where you have to know the location of the data and provide a specific URL to that data, the decentralized web uses\u00a0content-based<\/em>\u00a0routing.<\/p>\n

You don\u2019t say where<\/em> the data is; you request what<\/em> you want, and it is found and retrieved for you. Because the data is stored on many different computers, all of those computers can feed parts of the data to your computer at once, like a torrent download<\/a>. This is intended to lower latency, reduce bandwidth, and avoid bottlenecks caused by a single, central, server.<\/p>\n

Moving away from the centralized model means there is no focal point for hackers to attack. But the immediate concern for most people will be the idea that their files, images, and other media will be stored on other people\u2019s computers.<\/p>\n

It\u2019s not quite like that. IPFS isn\u2019t something you connect to and upload to. It\u2019s not a distributed, communal, DropBox. It\u2019s something that you participate in, by hosting a node or paying to use a professionally-provisioned node hosted by a cloud service. And unless you choose to share or publish something, it isn\u2019t going to be accessible to anyone else. In fact, the term \u201cuploading\u201d is misleading. What you\u2019re really doing is importing files into your own node.<\/p>\n

If you want a file to be accessible to others but need to keep the content restricted to a select few, you should encrypt it before you import it. The transmission of data is encrypted<\/a> in both directions, but imported files are purposefully not encrypted by default. This leaves the choice of encryption technology up to you. IPFS doesn\u2019t push a form of file storage encryption as the \u201cofficial\u201d encryption.<\/p>\n

How Data Is Stored<\/h2>\n

Data is stored in chunks of 256 KB, called IPFS objects. Files larger than that are split into as many IPFS objects as it takes to accommodate the file. One IPFS object per file contains links to all of the other IPFS objects that make up that file.<\/p>\n

When a file is added to the IPFS network it is given a unique, 24-character hash ID, called the\u00a0content ID<\/em>, or CID. That\u2019s how it is identified and referenced within the IPFS network. Recalculating the hash when the file is retrieved verifies the integrity of the file<\/a>. If the check fails, the file has been modified. When files are legitimately updated, IPFS handles the\u00a0versioning<\/em>\u00a0of files. That means the new version of the file is stored along with the previous version. IPFS operates like a distributed file system, and this concept of versioning provides a degree of immutability to that file system.<\/p>\n

Let\u2019s say you store a file in IPFS on your node, and someone called Dave requests it and downloads it to their node. The next person that asks for that file might get it from you, or from Dave, or in a torrent-like way with parts of the file coming from your node and from Dave\u2019s node. The more people who download the file, the more nodes there are to chip in and help with subsequent file requests.<\/p>\n

Garbage collection will periodically remove cached IPFS objects. If you want to permanently store a file you can\u00a0pin<\/em>\u00a0it to your node. That means it won\u2019t be cleaned out during garbage collection. You can pay for storage on cloud storage providers that expose your data to the IPFS network and keep them permanently pinned, and there are services specifically tailored to hosting websites that are IPFS accessible.<\/p>\n

If something on your website goes viral and drives massive waves of traffic to your website, the pages will be cached in all the nodes that retrieve those pages. Those cached pages will be used to help service further page requests, helping you ride the wave and satisfy demand.<\/p>\n

Of course, all of this depends on a sufficient number of nodes being on and available, and with enough pinned and cached data. And that requires participants.<\/p>\n

How to Install IPFS<\/h2>\n

Windows users can download and run the EXE file found on the IPFS release page<\/a>. If you\u2019re on a Mac, download the DMG file and drag it into Applications as you normally would. If you run into trouble, check out the official documentation<\/a>.<\/p>\n

For demonstration purposes, we\u2019ll walk through the installation on Ubuntu<\/a>. There are Snap packages available for IPFS and for the IPFS desktop client on any Linux distribution. If you just install IPFS you\u2019ll have a fully working IPFS node that you can control and administer using a browser. If you install the desktop client you don\u2019t need to use the browser, the client provides all of the same functionality.<\/p>\n

To install the Snaps use:<\/p>\n

sudo snap install ipfs<\/pre>\n
\"Installing<\/p>\n
sudo snap install ipfs-desktop<\/pre>\n
\"Installing<\/p>\n
Now you need to run the command to initialize your node.<\/p>\n
ipfs init<\/pre>\n
\"Initializing<\/p>\n
The following commands are suggested by IPFS if you run into difficulties and the daemon doesn\u2019t run, or you can\u2019t connect to it. On all the test computers we tried these were required, so you might as well go ahead and issue them now:<\/p>\n
ipfs config --json API.HTTPHeaders.Access-Control-Allow-Origin '[\"webui:\/\/-\", \"http:\/\/localhost:3000\", \"http:\/\/127.0.0.1:5001\", \"https:\/\/webui.ipfs.io\"]'<\/pre>\n
\"Configuring<\/p>\n
ipfs config --json API.HTTPHeaders.Access-Control-Allow-Methods '[\"PUT\", \"POST\"]'<\/pre>\n
\"Configuring<\/p>\n
sudo sysctl -w net.core.rmem_max=2500000<\/pre>\n
\"Adjusting<\/p>\n
With those out of the way, you can start the IPFS daemon.<\/p>\n
ipfs daemon<\/pre>\n
\"Starting<\/p>\n
When the daemon launches it reports the two addresses you can use to connect to it. One is for the IPFS desktop and the other is for the IPFS \u201cwebui\u201d or web user interface.<\/p>\n
\"The<\/p>\n
The Web Interface<\/h2>\n
Paste the webui address http:\/\/127.0.0.1:5001\/webui<\/code> into your browser to connect to the IPFS web front end.<\/p>\n
The default page is the \u201cStatus\u201d screen. This is a dashboard showing the status and activity of your node. It shows the size of the files you\u2019re hosting, plus the total size of the cached IPFS objects your node is hosting. This is data from elsewhere in the IPFS network. The dashboard also displays two real-time gauges showing inbound and outbound IPFS traffic, and a real-time graph showing the history of that traffic.<\/p>\n
\"IPFS<\/p>\n
To change to a different screen, click one of the icons in the left-hand sidebar. The \u201cFiles\u201d screen lets you see the files you\u2019ve imported into IPFS. You can use the blue \u201cImport\u201d button to search for files or folders on your computer that you want to import into IPFS.<\/p>\n
\"IPFS<\/p>\n
IPFS makes use of Merkle trees. These are a very efficient superset of binary hash trees,\u00a0invented in 1979 by Ralph Merkle<\/a>. If you have a lot of trees, you have a forest. The \u201cExplore\u201d icon opens a screen that lets you browse through different types of information stored within IPFS and its Merkle forest.<\/p>\n
\"IPFS<\/p>\n
There\u2019s an archive of cartoons from the well-known XKCD website<\/a>.\u00a0Clicking that option and selecting a cartoon delivers your chosen cartoon to you over IPFS.<\/p>\n
\"XKCD<\/p>\n
The \u201cPeers\u201d icon opens a world map that plots where your IPFS connections are located around the globe.<\/p>\n
\"IPFS<\/p>\n
Within a few minutes, we had connections from Australia, Belarus, Belgium, Canada, China, Finland, France, Germany, Japan, Malaysia, Netherlands, Norway, Poland, Portugal, Romania, Russia, Singapore, South Korea, Sweden, Taiwan, Turkey, the United Kingdom, and of course, the USA.<\/p>\n
Proof positive, if any were needed, that IPFS has generated a global buzz. You won\u2019t connect to every available node, of course. That would be inefficient.<\/p>\n
The IPFS Desktop Client<\/h2>\n
Find IPFS Desktop in your system\u2019s application launcher. On GNOME, with the IPFS daemon\u00a0stopped<\/em>, press your \u201cSuper\u201d key and type \u201cipfs.\u201d You\u2019ll see the blue IPFS cube icon.<\/p>\n
\"\"<\/p>\n
Click this icon and the desktop client will start. It will start the daemon itself.<\/p>\n
The desktop client\u2019s look and functionality are exactly the same as the web interface, but this time it is running as a stand-alone application.<\/p>\n
\"The<\/p>\n
One additional feature the application provides is an app-indicator in the notification area.<\/p>\n
This gives you quick access to a menu of options and a traffic light indicator of the status of your node. The indicator is green for normal running, red for an error, and yellow for starting up.<\/p>\n
\"The<\/p>\n
What Comes Next?<\/h2>\n
Nothing is going to suddenly replace the existing, centralized web, but over time things will evolve. Perhaps the IPFS is a glimpse of what it might evolve into.<\/p>\n<\/div>\n