easy_install no longer working with SourceForge-hosted projects?

Plumbing Life's Depths

Calendar

Back July '10
Mo Tu We Th Fr Sa Su
Thu July 29 2010
      1 2 3 4
5 6 7 8 9 10 11
12 13 14 15 16 17 18
19 20 21 22 23 24 25
26 27 28 29 30 31  

Quicksearch

Archives

July 2010
June 2010
May 2010
Recent...
Older...

Categories



All categories

Syndicate This Blog

XML RSS 0.91 feed
XML RSS 1.0 feed
XML RSS 2.0 feed
ATOM/XML ATOM 0.3 feed
ATOM/XML ATOM 1.0 feed
XML RSS 2.0 Comments

Blog Administration

Open login screen

Comments

Jim about GIT is a PITA (Stupid, stupid, stupid source code control...)
2010-07-25 14:02
> and would have no Trac integ ration The trac-bzr plugin[ 1] seems to provide good integ ration between bzr and t [...]


Dr Clue about Curiouser and curiouser with Asterisk manager interface (pyst doesn't seem to realise that there are event-generating queries)
2010-07-13 21:47
I've always been fascinated wi th the Asterisk AMI interface. So much so that I married tha t fascination with the [...]


Mike C. Fletcher about Mocker's hidden gem...
2010-07-03 21:32
Yes, only references in dicti onaries are replaced, so hold ing references in lists, tuple s, etceteras keeps them alive.


90 30 plc about Mocker's hidden gem...
2010-07-03 11:18
They hold references to remove and install?


Mike C. Fletcher about Mocker's hidden gem...
2010-06-24 08:34
There's higher-level objects w hich are tracking what is repl aced (the actual Mock objects) . They hold references [...]


Virgil Dupras about Mocker's hidden gem...
2010-06-24 08:23
I haven't tried it, but it see ms to me like this approach ha s one fundamental problem: If you replace all refs o [...]


Mike C. Fletcher about Mocker's hidden gem...
2010-06-24 08:22
That's the "magic" that made m e go "ooh shiny" :-) . It's a neat little hack to make a nic e feature possible. I [...]


Michael Foord about Mocker's hidden gem...
2010-06-24 06:03
That's even more evil than the mock patch decorator... :-) ( patch only replaces names in s copes - so it patches ou [...]


Yaniv Aknin about Stub/Mock-a-Process Module
2010-06-06 18:33
blush Oh. :-)


Mike C. Fletcher about Stub/Mock-a-Process Module
2010-06-06 11:07
That's what the module does (a utomatically), but on a per-te st-run basis, and only for the process being tested (i [...]


Yaniv Aknin about Stub/Mock-a-Process Module
2010-06-06 02:43
Maybe I'm missing something im portant here, but why not just write small scripts to mimic whatever dangerous utili [...]


Mike C. Fletcher about Stub/Mock-a-Process Module
2010-06-05 15:17
I thought about stubbing out t he python call to the process in the current process, but I want something which stu [...]


Michael Foord about Stub/Mock-a-Process Module
2010-06-05 14:47
Hmm... if Mock isn't flexibl e enough to handle mocking pro cesses adequately then I'd lik e to know how it could b [...]


Omri about ToscaWidgets JQuery and Flot Plotting (Tutorialish-ly)
2010-05-19 10:27
Hey, maybe it's a stupid new bie question, but where and ho w exactly should the patching of the core take place? [...]


Mike C. Fletcher about Setting up a DHCP test environment in QEMU
2010-05-04 14:36
I used Qemu and VirtualBox pre tty extensively back when I wa s working for the OLPC, but mo st of the stuff we were [...]


Tuesday, August 18. 2009

easy_install no longer working with SourceForge-hosted projects?

It seems like all of the projects I host on SourceForge are no longer easy-installable.  The only ones that can install are the ones that have been uploaded to PyPI, and then only the versions on PyPI install (i.e. a later version on SF doesn't install or prevent an earlier version from installing).  I'm guessing this is a further iteration in the "war" of hacks that involves downloading HTML and parsing it in order to find links; SF's recent restructuring of their files-for-download stuff probably just broke the parser-based stuff (likely SF is using AJAX to populate the sets on the pages).

So maybe I just switch to PyPI upload for everything.  I'm guessing that some PSF donor is paying for the bandwidth/storage for PyPI.  I don't have a huge bandwidth footprint for the set of projects I maintain.  Or maybe I should set up a simple "downloads" page that can be easily parsed by easy_install with direct links for each version of each project and update the download links in the project metadata to point to that (ick).  Or maybe use Launchpad's file-releases?

Ah well, not going to solve this this afternoon.  Client projects beckon.


in Snaking at 13:43 | Comments (5)
Trackbacks
Trackback specific URI for this entry
No Trackbacks
Comments
Display comments as (Linear | Threaded)
I think hosting on PyPI is the best way to go. Anything that relies on going off to some other URL introduces more chances of something going wrong. I personally think we'd all have been better off if easy_install (setuptools) didn't try to be so clever at finding stuff, though I can see that it was needed for bootstrapping as well.
#1 Martijn Faassen on 2009-08-18 16:11 (Reply)
PyPI sdist uploads == goodness.
#2 Marius Gedminas (Homepage) on 2009-08-18 17:38 (Reply)
This is interesting - I wonder how many other people are wary of uploading to PyPI because of perceived hosting limitations? And how do we dispel those myths?
#3 Richard Jones on 2009-08-18 20:56 (Reply)
Hi, I work at SourceForge, Inc. We didn't intend to break pypi downloads from SourceForge during the recent changes, obviously. And while I concur with http://simonwillison.net/2009/Aug/19/easyinstall/ if its not too difficult we should be able to adjust the downloading page to make it work again (AJAX isn't used for anything required for downloading). I'm not familiar with how easy_install scrapes and decides which URL to use, so if someone could point me where to look for that or what should change, that'd be great.

URLs like these (for example) should work:

http://sourceforge.net/projects/pytidylib/files/pytidylib-0.1.2.tar.gz/download

http://downloads.sourceforge.net/project/pytidylib/pytidylib-0.1.2.tar.gz

For automated scripts (no referer) those redirect straight to the file.

Note: for official support from SourceForge, please see http://sourceforge.net/support
#4 Dave Brondsema (Homepage) on 2009-08-19 10:04 (Reply)
Hi Dave,

Thanks for replying. I also happen to agree that link-parsing is a hacky way to handle the situation, but whatever, the "boot strap" solution has become accepted practice.

I honestly don't know how easy_install processes the pages. I'm "off" on thesis work this weekend, but I'll try to look into it and get back to you next week.

I'm pretty much convinced what we should do is migrate all of the packages into the PyPI archives and then set up multiple mirrors for the archives, but getting SF hosted projects working in the short term would certainly help too.
#4.1 Mike C. Fletcher (Homepage) on 2009-08-21 14:52 (Reply)
Add Comment
Note: If you're here from a DoFollow list, please go elsewhere. This blog is actively monitored and spam removed, and it is now NoFollow rather than DoFollow.
Enclosing asterisks marks text as bold (*word*), underscore are made via _word_.
Standard emoticons like :-) and ;-) are converted to images.
E-Mail addresses will not be displayed and will only be used for E-Mail notifications

To prevent automated Bots from commentspamming, please enter the string you see in the image below in the appropriate input box. Your comment will only be submitted if the strings match. Please ensure that your browser supports and accepts cookies, or your comment cannot be verified correctly.
CAPTCHA