Added robots.txt

config/_default/config.toml

@@ -6,6 +6,9 @@ defaultContentLanguage = "en"
 defaultContentLanguageInSubdir = true
 hasCJKLanguage = true
 
+# Robots.txt
+enableRobotsTXT = true
+
 summaryLength = 70
 buildFuture = true
 

content/en/posts/directory_cleanup.md

@@ -31,7 +31,9 @@ A clean home/project directory allows us to be able to work productively, withou
 This is a simple script to help you clean your directory in seconds
 
 ### Caution
+{{< alert theme="danger" dir="ltr" >}}
 __DO NOT__ run the script on any directory containing system/important files.
+{{< /alert >}}
 
 ## Dependencies
 * [Python3.8](https://www.python.org/)

layouts/robots.txt

@@ -0,0 +1,11 @@
+User-agent: *
+Allow: /
+
+User-agent: *
+Disallow: /gallery
+
+User-agent: *
+Disallow: /static
+
+User-agent: *
+Disallow: /images