J
Jacobtomlinson Dev
@jacobtomlinson
Imported Bluesky account. Main topic: tech. Original handle: jacobtomlinson.dev.
0 Following
0 Followers
J
Replying to
@mitsuhiko
If you’re saying that it would’ve been better for conda to not be necessary in the first place then I totally agree with that.
15,000 views
J
Replying to
@mitsuhiko
That’s a great goal! But this thread started with “let’s unite under uv and remove the need for conda/pixi”. So much of this discussion has been around the value that the conda ecosystem provides today. It’s dismissive of the needs of the science community to call those things overcomplicated.
15,000 views
J
Replying to
@mitsuhiko
Yeah there are a lot of non-Python things on Conda Forge. But there are also a lot of things there that are depended on by Python packages. Those would need to be packaged on PyPI. But maybe Nix is the solution to reproducible environments if PyPI isn’t going to be that.
15,000 views
J
Replying to
@mitsuhiko
Conda Forge is a community of dedicated packagers more than a technical solution (although they have built impressive CI infrastructure for building packages). PyPI would work fine as the place to put the files. But we will need a PyPI-Forge community to build them.
15,000 views
J
Replying to
@jacobtomlinson
My new favourite LLM generated sentence: "Avoid telling the pig that you have more apples if you do not have any left, as this can lead to disappointment and frustration."
5,200 views
J
Replying to
@jacobtomlinson
Ollama is super nice for playing around with LLMs locally. github.com/ollama/ollama
5,200 views
J
Replying to
@jacobtomlinson
First summary is looking good! I'm running ollama on my PC with an old GeForce GTX 1080 GPU. Then using langchain to invoke the llama3:8b model.
5,200 views
J
J
Replying to
@dhirschfeld
I think it shoudl be fine if these system installed packages are also packaged as wheels. The Conda Forge community has already done much of this work, it will need doing again for PyPI.
15,000 views
J
Replying to
@jacobtomlinson
I have everything in place to load the contents of the page and call a function to generate the summary. Then replace the contents of the directive with the generated summary. Now I need to wire up the LLM to do the actual generation. I also need to think about caching to avoid repeat LLM calls.
5,200 views
J
Replying to
@mitsuhiko
Each of those things require technical changes either in pip/uv or PyPI to work robustly. But I agree there needs to be drive on the PyPI side to do these things.
15,000 views
J
Replying to
@dhirschfeld
Or we could add the things we love about conda to pip/uv/PyPI and bring the benefits of conda to the whole Python community. For example dynamic linking in wheels is in the works and things will get a lot better after that.
15,000 views
J
Replying to
@jacobtomlinson
There's still a lot of work to be done to catch up with conda. Optional constraints, virtual packages and shared compiled libraries to name a few. But it's not crazy to imagine these things arriving over the next few years.
15,000 views
J
Replying to
@mitsuhiko
Conda gives you two things: 1. Language agnostic environment management 2. The ability to build more complex packages with compiled dependencies Assuming we only care about Python, uv has given us really nice environment management, and wheels have helped with build dependencies.
15,000 views
J
Replying to
@jacobtomlinson
I really appreciate Copilot for Qs like "I have the name of the Sphinx document, how do I load that document as a string?" Past me would spend an hour digging through the Sphinx API reference to figure this out. `self.state.document.settings.env.app.builder.env.get_doctree(doc_name).astext()`
5,200 views
J
J
Replying to
@jacobtomlinson
Ideally I want to be able to attach a debugger during the build. I use VS Code so let's hook up the sphinx build to the debugger. Calling `sphinx-autobuild` is functionally the same as `python -m sphinx_autobuild` so we can use the Python Module debugger to invoke it.
5,200 views
J
Replying to
@jacobtomlinson
I have a very basic sphinx extension written out now. I can add a custom admonition called docref which will link to another page and include a summary. Right now the summary is hand written and it doesn't link though.
5,200 views
J
Replying to
@jacobtomlinson
I'm going to need some boilerplate documentation to start summarising. This feels like a good use case for Copilot to hallucinate some entertaining nonsense.
5,200 views
J
Replying to
@jacobtomlinson
I've created some sample documentation with sphinx-quickstart and then I'm using sphinx-autobuild to rebuild the docs every time I make a change. I'm also using uv to keep dependency management clean. www.sphinx-doc.org/en/master/us... pypi.org/project/sphi... github.com/astral-sh/uv
5,200 views
J
Replying to
@jacobtomlinson
I've started a new repo and used `hatch init` to create the boilerplate structure. I'll push code there frequently today. github.com/jacobtomlins...
5,200 views
J
Replying to
@jacobtomlinson
This project was hugely inspired by Aarti Jha's talk at PyData NYC "The Art of Compression: Crafting Insightful Summaries with LLMs" www.youtube.com/watch?v=kCCC...
5,200 views