Solved [Solved] Hidden distfiles

M

max21

I have been searching for hours for needed distfiles. There are very few FTP’s outside of FreeBSD that maintains these files but many of them state that they are untested and after trying three of them they lead to even more errors. It got to the point I felt “this is all by design”. Just minutes ago, I found the actual FreeBSD link that I should have found in the first place. Right!

http://ftp.freebsd.org/pub/FreeBSD/distfiles/README.txt

Our distfiles cache has been moved to:
http://distcache.FreeBSD.org/ports-distfiles/
distfiles can be fetched by name from there, as specified
in the corresponding port that uses it.
Click to expand...

So I went to: http://distcache.freebsd.org/ports-distfiles/ and this is all it had to offer:

Code: 
403 Forbidden
nginx

!@#$%^&. How should I feel now? Is there a reason to bury supported OS files so deep that the Beastie can’t find them? Could someone provide the link to obtaining the legit FreeBSD 9.2 distfiles before I crack?

Thank you.
 
Re: Hidden distfiles

Distfiles are supposed to be fetched from an original upstream source or a port maintainer's mirror anyway.
 
Re: Hidden distfiles

Thanks @fonz for your reply but I need the proven working link where I can fetch or download those files individually. I know what it is supposed to do. I did not want to post all the details to the question, but I installed the original source. Any “NOT FOUND” are the result for more than many. The link I posted above is a direct FreeBSD link that was designed for fetching I thought. I found it at http://www.freebsd.org. Did you try it? What was your result? I installed FreeBSD-9.2-RELEASE-amd64-dvd1.iso, but I had to download kBuild-0.1.9998 and other files from outside maintainers and install them manually. As you see, not all of them work or should even be trusted. I’m not an expert but I am trying work from a source with missing sources. BTW, I did try the CD from the start, then, from there I been through the ringer for over a week with SVN and such. Now I’m back to the CD, realizing that I need to manually install many distfiles. I learn a lot from not getting anywhere and I did my best to not ask for help, but could you or someone provide the link to obtaining the legit FreeBSD 9.2 distfiles?

Code: 
root@k1:~ # cd /usr/ports/emulators/virtualbox-ose
root@k1:/usr/ports/emulators/virtualbox-ose # make install clean
===>   virtualbox-ose-4.2.16_2 depends on executable: yasm - found
===>   virtualbox-ose-4.2.16_2 depends on executable: as86 - found
===>   virtualbox-ose-4.2.16_2 depends on executable: xsltproc - found
===>   virtualbox-ose-4.2.16_2 depends on executable: kmk - not found
===>    Verifying install for kmk in /usr/ports/devel/kBuild
=> kBuild-0.1.9998r2662-src.tar.gz doesn't seem to exist in /usr/ports/distfiles/.

=> Attempting to fetch ftp://ftp.netlabs.org/pub/kbuild/kBuild-0.1.9998r2662-src.tar.gz

fetch: ftp://ftp.netlabs.org/pub/kbuild/kBuild-0.1.9998r2662-src.tar.gz: File 

unavailable (e.g., file not found, no access)

=> Attempting to fetch http://tmp.chruetertee.ch/kBuild-0.1.9998r2662-src.tar.gz

fetch: http://tmp.chruetertee.ch/kBuild-0.1.9998r2662-src.tar.gz: No address record

=> Attempting to fetch http://disasterarea.chruetertee.ch/kBuild-0.1.9998r2662-src.tar.gz

#########
#########  I found a copy from other maintainer, no FreeBSD maintaner found!
#########

freebsd.amd64/release/stage/usr/local/bin/kDepIDB
install: warning: Not hard linking, mode differs: 0755, desires 0555
install: src path '/usr/ports/devel/kBuild/work/kBuild-0.1.9998/out/freebsd.amd64/release/obj/kDepIDB/kDepIDB'
install: dst path '/usr/ports/devel/kBuild/work/kBuild-0.1.9998/out/freebsd.amd64/release/stage/usr/local/bin/kDepIDB'
kBuild: Installing kDepObj => /usr/ports/devel/kBuild/work/kBuild-0.1.9998/out/freebsd.amd64/release/stage/usr/local/bin/kDepObj
install: warning: Not hard linking, mode differs: 0755, desires 0555
install: src path '/usr/ports/devel/kBuild/work/kBuild-0.1.9998/out/freebsd.amd64/release/obj/kDepObj/kDepObj'
install: dst path '/usr/ports/devel/kBuild/work/kBuild-0.1.9998/out/freebsd.amd64/release/stage/usr/local/bin/kDepObj'
kBuild: Installing kmk_gmake => /usr/ports/devel/kBuild/work/kBuild-0.1.9998/out/freebsd.amd64/release/stage/usr/local/bin/kmk_gmake
install: warning: Not hard linking, mode differs: 0755, desires 0555
install: src path '/usr/ports/devel/kBuild/work/kBuild-0.1.9998/out/freebsd.amd64/release/obj/kmk_gmake/kmk_gmake'
install: dst path '/usr/ports/devel/kBuild/work/kBuild-0.1.9998/out/freebsd.amd64/release/stage/usr/local/bin/kmk_gmake'
kBuild: Linking kmk
kBuild: Installing kmk => /usr/ports/devel/kBuild/work/kBuild-0.1.9998/out/freebsd.amd64/release/stage/usr/local/bin/kmk
install: warning: Not hard linking, mode differs: 0755, desires 0555

#########
#########  I found a copy from other maintainer, no FreeBSD maintaner found!
#########

fetch: http://ftp.jaist.ac.jp/pub/qtproject/official_releases/qt/4.8/4.8.4/qt-everywhere-opensource-src-4.8.4.tar.gz: Not Found

=> Attempting to fetch http://mirrors.neusoft.edu.cn/qt/official_releases/qt/4.8/4.8.4/qt-everywhere-opensource-src-4.8.4.tar.gz
fetch: http://mirrors.neusoft.edu.cn/qt/official_releases/qt/4.8/4.8.4/qt-everywhere-opensource-src-4.8.4.tar.gz: Not Found



=> Attempting to fetch ftp://ftp.FreeBSD.org/pub/FreeBSD/ports/distfiles/KDE/qt-everywhere-opensource-src-4.8.4.tar.gz
fetch: ftp://ftp.FreeBSD.org/pub/FreeBSD/ports/distfiles/KDE/qt-everywhere-opensource-src-4.8.4.tar.gz: File unavailable (e.g., file not found, no access)
=> Couldn't fetch it - please try to retrieve this
=> port manually into /usr/ports/distfiles/KDE and try again.
*** [do-fetch] Error code 1



Stop in /usr/ports/devel/qt4-linguist.
*** [build-depends] Error code 1

Stop in /usr/ports/emulators/virtualbox-ose.
*** [install] Error code 1

Stop in /usr/ports/emulators/virtualbox-ose.
root@k1:/usr/ports/emulators/virtualbox-ose #
 
Last edited by a moderator:
Re: Hidden distfiles

There is no "one link" to download each and every distfile that you might need. As @fonz said:
Distfiles are supposed to be fetched from an original upstream source or a port maintainer's mirror
Click to expand...
.
Might I suggest you read https://www.freebsd.org/doc/handbook/ports-using.html that describes what the ports system is and how it works.

Looking at the error you posted, you might need to update the ports collection you have on your machine by following the instructions in that handbook section, because the place where the specific distfile you need has moved, and the port has been updated to point to that new location.
 
Last edited by a moderator:
Re: Hidden distfiles

To elaborate on this:
  • FreeBSD itself usually only mirrors distfiles when there's a specific need for that. As mentioned above, distfiles are supposed to be fetched from the original upstream source (distfiles contain third-party software, after all) or a port maintainer's mirror. Fetching them from FreeBSD's own mirror is only tried as a last resort. Moreover, many distfiles are not mirrored by FreeBSD itself. In fact, a committer has to manually put a distfile up for mirroring by FreeBSD itself and as said this is usually only done when there are good reasons for doing so.
  • The place where FreeBSD keeps its distfiles has changed. As can be found in your original post, they are now at a place called Distcache and can only be fetched by name. In other words, you can download specific files directly, but you are not allowed to just list the contents of the http://distcache.FreeBSD.org/ports-distfiles/ directory.
  • The ports tree has been updated to reflect this change, but you're not the first to get caught out. You need a recent ports tree, not the one that came with your FreeBSD release. Many things have changed since then.
 
Re: Hidden distfiles

Thanks @ljboiler, now I get it. I’m sorry @fonz for not understanding your point.
Moreover, many distfiles are not mirrored by FreeBSD itself. In fact, a committer has to manually put a distfile up for mirroring by FreeBSD itself and as said this is usually only done when there are good reasons for doing so.
Click to expand...
Ok, I take it to mean I have to see Pete to find Paul. Sorry FreeBSD for losing faith. Yesterday I found a few sites that maintain some of those direct links to FreeBSD's FTP. Come to learn, SVN only had three files instead of hundreds that were holding my VirtualBox install.

This has been a trip. I forgot what I did, but knowing myself, I already have a copy of VirtualBox-4.2.16.tar.bz2 and had copied it into the ports/distfiles directory. Or SVN could have installed for me. Either way, it costs nothing to copy it yourself.
Code: 
Now Goto:
http://www.filewatcher.com/m/Dev86src-0.16.18.tar.gz.705030-0.html
To retrieve:
ftp://ftp.tw.freebsd.org/pub/FreeBSD/FreeBSD/ports/distfiles/Dev86src-0.16.18.tar.gz

Then Goto:
http://distfiles.icmpv6.org/distfiles/
To retrieve:
kBuild-0.1.9998r2662-src.tar.gz 

And finally Goto:
http://www.filewatcher.com/m/qt-everywhere-opensource-src-4.8.4.tar.gz.236593028-0.html
To retrieve:
ftp://ftp.tw.freebsd.org/pub/ports/distfiles/KDE/qt-everywhere-opensource-src-4.8.4.tar.gz

Now FreeBSD 9.2 is nearly fully-equipped and backed-up. Now to try FreeBSD-10 or wait for FreeBSD-11.

Thanks again.

I can't find the Solved button. Please mark as SOLVED.
 
Last edited by a moderator:
Re: Hidden distfiles

max21 said:
I can't find the Solved button. Please mark as SOLVED.
Click to expand...
Done.

And for future reference: unfortunately there currently isn't a Solved button. You have to edit the first post in the thread (if that's yours of course) and manually change the topic title. Sorry for the inconvenience, we're working on it.
 
You must log in or register to reply here.
Back
Top