MetaProduct User Forums

Portable Offline Browser virtual box

Portable Offline Browser

more details   development history   free download   buy now  

Downloading zip-files with strange long linkname

Author Message
color 2/1/2015 10:19:31 AM
How to download only all zip-files from a site that has

1) starting site with 5 pages: http://www.name.com/photo/type/directoryname?page={:1..5}

2) Each page has multiple sitelinks like :
http://www.name.com/photo/set/311912 ..... http://www.name.com/photo/set/37882 .......

3) Every of the above sitelink has the pictures with thumbs and three different links to zipfiles with strange long name to a different site

http://venture.name-network.com/secure/content/t/tri033/311831/3000/filename_3000_all.zip?s=1422800728&e=1422811528&h=68f6036a0fb6cd193b640ed5e814d007&site=1000



So what kind of settings and levels must I set , to download only all the zip-files containing *3000_all.zip* from the subdirectories ?

Thanks for your help !
Oleg Chernavin 2/1/2015 7:47:27 PM
What if you would set a high level, like 20, allow all servers and directories and use URL Filters - Filename section with Included keywords:

/photo/set/*
*.zip?

Would this work as you want?

Best regards,
Oleg Chernavin
MP Staff
color 2/6/2015 11:59:55 AM
Hi Oleg,

your tip works fine but I still have problem with the Filenames.

I have a lot of directories and strange file-extensions which windows did not recognize as *.zip

On my pc I have now the files in directories like this:

venture.name-network.com/secure/content/t/tri033/311831/3000/filename_3000_all.zip?s=1422800728&e=1422811528&h=68f....

How can I change them to download all in one directory like this:

name-network/zip/filename_3000_all.zip

The part after "?" should ignored and all files should be in one directory.

Can you please help me again with renaming ?

Thanks alot for your good work !
Best Regards

Color
Oleg Chernavin 2/8/2015 9:22:02 AM
What about exporting the downloaded site? Please select it, click the Export Files button and make sure that the Standard Extensions box is checked.

Oleg.
color 2/8/2015 1:24:01 PM
Thanks for that great tip !

Its getting better :
it changes with Joliet-Format from
3000_jew009rwl_304506_3000_all.zip@s=1423154675&e=1423165475&h=1368ae0d98599f84e14e8c4d9b6a5494&site=1

to

3000_jew009rwl_304506_3000_all.zips1423154675e1423165~1.zip

Still a little strange !

With 8+3 Dos-Format its too short --> 3000_l~1.zip


Any advise for shorting filename on the fly to --> 3000_jew009rwl_304506_3000_all.zip

Best regards
color

Oleg Chernavin 2/8/2015 5:31:04 PM
There is one other way - please select the Project, click the Properties button on toolbar, go to the Parsing section and click the URL Substitutes button. Add a rule:

URL:
*
Replace:
.zip?*
With:
.zip

Make this rule to apply to filenames only.

Then redownload this Project.

Oleg.