<<screen grab>>

The problem (apart from having corrupted data) is that the files affected will NOT copy anywhere. So, since in my case I was trying to clear data off a hard drive, I would have no option but to delete the files. This is a shame since many of the files may still be use-able and probably only a few dropped bits of data are causing the problem.

The other issue is: surely this shouldn’t have happened in the first place… the files were copied from elsewhere previously and, at that time windows explorer didn’t give any errors…

Here’s the rub – Windows explorer doesn’t verify the data copied after it is written!!

So, if you’d like to know how to get around this issue, read on…

• Use Teracopy – Win explorer is shit for copying large amounts of data – NEVER use it for that purpose!
• Don’t bother with Data recovery tools, unless you specifically know the data was deleted
• Use JFileRecovery 0.94 (softpedia link is good) – It can heal some files, but most importantly, will still copy the data regardless of corruption, appending “_recovered” to the file.
• Make sure to make a note for future reference that the file is possibly damaged [it rather depends what it is and whether the data is critical – e.g. audio and video files will probably still play fine].
• <<give a brief run-down of how to use>>
• In JFileRecovery, you can play with the Block Size and timeout if you want a more “thorough” recovery. Personally, I decreased the block size to 14,848 and increased the timeout to 2000ms to give a balance between the time it takes to recover and its likelihood of recovering data.

make app to add JSON export (see tabs!!)

in cmd or powershell (in the directory where script it) run: python <<script>>.py.. change the channel url and target directory at top of script. (may need python on win 10), if so allow it to be installed.

may need selenium (pip3 install selenium) see here: https://bobbyhadz.com/blog/python-no-module-named-selenium

may need bs4 module (beautiful soup). : pip install beautifulsoup4

I sincerely hope this works for you – it didn’t work for me!

How to get all video titles and video links

see here: https://www.quora.com/Is-there-any-Python-module-to-extract-all-video-URLs-from-a-YouTube-channel. copy- paste from console to sheet

WORKS!

next… use this: https://github.com/rohit-chouhan/youtube-thumbnail-api

to get image urls

call as .js in head script

This introduced me to brotli, a compression algorithm for (static) assets, supported by most major browsers but significantly not Internet Explorer or Safari

As far as apache2 server is concerned, stream compression with brotli is not supported (yet), so I intended to compress static assets on my localhost site, prior to uploading to live, with a fallback gzip version for non-compatible browsers.

Here’s how I failed to do it…

First install brotli

(probably the easy way, I didn’t test this as I went with a rather problematic git install – see below)

sudo apt install brotli -y

install with git <<get git>>:

NOTE: I installed on WSL2 and had to log in as root to get this to work

sudo su -

git clone https://github.com/Microsoft/vcpkg.git

cd vcpkg

At this point, make sure you have the necessary zip utilities:

apt-get install curl zip unzip tar

then:

./bootstrap-vcpkg.sh

./vcpkg integrate install

Note: the second of the above commands will first install cmake if you dont’ already have it – be patient as there is no progress indicator!

TROUBLESHOOTING

After cmake was installed, I then attempted to run ./vcpkg integrate install again and was presented with the following error:

error: building brotli:x64-linux failed with: BUILD_FAILED
Please ensure you're using the latest port files with `git pull` and `vcpkg update`.
Then check for known issues at:
    https://github.com/microsoft/vcpkg/issues?q=is%3Aissue+is%3Aopen+in%3Atitle+brotli
You can submit a new issue at:
    https://github.com/microsoft/vcpkg/issues/new?template=report-package-build-failure.md&title=[brotli]+Build+error
Include '[brotli] Build error' in your bug report title, the following version information in your bug description, and attach any relevant failure logs from above.
    vcpkg-tool version: 2022-09-01-dfb82802c8cc562ce3b665a904a65b22314de724
    vcpkg-scripts version: 01b29f6d8 2022-09-16 (2 days ago)

You can also use the prefilled template from /root/vcpkg/installed/vcpkg/issue_body.md.

The “prefilled template” .md file referred to in the last line informed me that pkg-config needed to be installed, so I did the following:

apt install pkg-config

then I made sure I was back in the /root/vcpkg directory [cd /root/vcpkg] and ran the install command again [vcpkg install brotli]

Configure Apache2

sudo a2enmod brotli

Next, enable brotli in the host config file for the website in question (for example nano /etc/apache2/sites-available/<<mysite>>.conf if it’s a site that’s not running yet or nano /etc/apache2/sites-enabled/<<mysite>>.conf if the site is currently enabaled on your server). Add the following to the config file:

<IfModule mod_brotli.c>
    AddOutputFilterByType BROTLI_COMPRESS text/html text/plain text/xml text/css text/javascript application/javascript
</IfModule>

the config file should now look like this:

<VirtualHost *:80>
      ServerAdmin webmaster@localhost
      ServerName example.com
      DocumentRoot /var/www/
 
      <IfModule mod_brotli.c>
            AddOutputFilterByType BROTLI_COMPRESS text/html text/plain text/xml text/css text/javascript application/javascript
      </IfModule>
 
      ErrorLog ${APACHE_LOG_DIR}/error.log
      CustomLog ${APACHE_LOG_DIR}/access.log combined
</VirtualHost> 

Finally, reload apache2:

service apache2 reload

DIDN’T WORK!! Try this:

insert this code into .conf file instead:

<IfModule mod_headers.c>
    # Serve brotli compressed CSS files if they exist
    # and the client accepts brotli.
    RewriteCond "%{HTTP:Accept-encoding}" "br"
    RewriteCond "%{REQUEST_FILENAME}\.br" "-s"
    RewriteRule "^(.*)\.css"              "$1\.css\.br" [QSA]

    # Serve brotli compressed JS files if they exist
    # and the client accepts brotli.
    RewriteCond "%{HTTP:Accept-encoding}" "br"
    RewriteCond "%{REQUEST_FILENAME}\.br" "-s"
    RewriteRule "^(.*)\.js"               "$1\.js\.br" [QSA]


    # Serve correct content types, and prevent double compression.
    RewriteRule "\.css\.br$" "-" [T=text/css,E=no-brotli:1]
    RewriteRule "\.js\.br$"  "-" [T=text/javascript,E=no-brotli:1]


    <FilesMatch "(\.js\.br|\.css\.br)$">
      # Serve correct encoding type.
      Header append Content-Encoding br

      # Force proxies to cache brotli &
      # non-brotli css/js files separately.
      Header append Vary Accept-Encoding
    </FilesMatch>
</IfModule>

That didn’t work either… I give up. For now!

Here are my notes on how to get the most out of it.

1. Define your sites
2. Check the file transfer settings – binary is best
3. Use the BOTTOM pane!
4. Use the Queue, THEN download the files
5. Set you preferred editors for file-types
6. Edit, switch back, OK to replace.
7. update new only