<![CDATA[i bet you can already picture my 'why knowing basic networking and self hosting is important' tirade]]>RE: https://mstdn.social/@mattwilcox/116056989955523921

i bet you can already picture my 'why knowing basic networking and self hosting is important' tirade

]]>https://board.circlewithadot.net/topic/e8454cbf-5a67-4ab6-9050-6432536c82a3/i-bet-you-can-already-picture-my-why-knowing-basic-networking-and-self-hosting-is-important-tiradeRSS for NodeFri, 15 May 2026 08:26:20 GMTThu, 30 Apr 2026 16:46:59 GMT60<![CDATA[Reply to i bet you can already picture my 'why knowing basic networking and self hosting is important' tirade on Thu, 30 Apr 2026 17:29:58 GMT]]>@Viss That's about where I am right now. I've got a few models running locally on an older gaming box, they're not inline with any work flows.

]]>https://board.circlewithadot.net/post/https://infosec.exchange/users/nerdpr0f/statuses/116494840539015376https://board.circlewithadot.net/post/https://infosec.exchange/users/nerdpr0f/statuses/116494840539015376Thu, 30 Apr 2026 17:29:58 GMT<![CDATA[Reply to i bet you can already picture my 'why knowing basic networking and self hosting is important' tirade on Thu, 30 Apr 2026 17:26:30 GMT]]>@nerdpr0f a good place to start may be to just install ollama somewhere and start with single one-liner commands. cuz you can literally just shoot a single sentence into ollama at the command line, and it'll go into a model, and output will happen. no conversation, no system prompt, no harness - nothing. just input and output.

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/Viss/statuses/116494826925382840https://board.circlewithadot.net/post/https://mastodon.social/users/Viss/statuses/116494826925382840Thu, 30 Apr 2026 17:26:30 GMT<![CDATA[Reply to i bet you can already picture my 'why knowing basic networking and self hosting is important' tirade on Thu, 30 Apr 2026 17:24:47 GMT]]>@Viss Admittedly, I have quite a lot of work to do on this. I don't really have any LLMs inline for any of my workflows at the moment. Since I'm not research faculty, most of the development I do is oriented around classes and LLMs are... just overkill for that. I can write a malware sample from scratch, say, for my reversing class in substantially less time than it would take to set up that kind of pipeline.... even if the pipeline is more efficient long term.

So, I need to figure out these work flows from (more or less) scratch at the moment.

]]>https://board.circlewithadot.net/post/https://infosec.exchange/users/nerdpr0f/statuses/116494820145628299https://board.circlewithadot.net/post/https://infosec.exchange/users/nerdpr0f/statuses/116494820145628299Thu, 30 Apr 2026 17:24:47 GMT<![CDATA[Reply to i bet you can already picture my 'why knowing basic networking and self hosting is important' tirade on Thu, 30 Apr 2026 17:19:43 GMT]]>@nerdpr0f you may find that my proposal is 100% congruent with exactly what you are trying to do, as basically no matter what you use an llm tui for, the problems of prompt engineering, harness engineering and the next one coming im calling memory management affect absolutely anything you could possibly try to do with a tui

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/Viss/statuses/116494800233613688https://board.circlewithadot.net/post/https://mastodon.social/users/Viss/statuses/116494800233613688Thu, 30 Apr 2026 17:19:43 GMT<![CDATA[Reply to i bet you can already picture my 'why knowing basic networking and self hosting is important' tirade on Thu, 30 Apr 2026 17:18:03 GMT]]>@Viss That sounds interesting, but my main focus - as much as I hate it - is going to be around making use of this platform in some of my existing courses (exploit dev, reversing, web sec, mobile sec) in line with actual industry use cases.

]]>https://board.circlewithadot.net/post/https://infosec.exchange/users/nerdpr0f/statuses/116494793650506148https://board.circlewithadot.net/post/https://infosec.exchange/users/nerdpr0f/statuses/116494793650506148Thu, 30 Apr 2026 17:18:03 GMT<![CDATA[Reply to i bet you can already picture my 'why knowing basic networking and self hosting is important' tirade on Thu, 30 Apr 2026 17:12:56 GMT]]>@nerdpr0f if you want a real interesting experience, clone down codex, light it up inside of a container or some kind, attach it to the llm, and then ask the llm to review its code and start implementing memory management type features. thats the current big push - to figure out how to get these harnesses to remember like a person does, and not go all memento on you every time you stop/restart the harness

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/Viss/statuses/116494773577364872https://board.circlewithadot.net/post/https://mastodon.social/users/Viss/statuses/116494773577364872Thu, 30 Apr 2026 17:12:56 GMT<![CDATA[Reply to i bet you can already picture my 'why knowing basic networking and self hosting is important' tirade on Thu, 30 Apr 2026 17:02:16 GMT]]>@Viss Yeah. My institution just rolled out an in-house developed platform that, more or less, does this. Playing around with this is on my summer to-do list.

]]>https://board.circlewithadot.net/post/https://infosec.exchange/users/nerdpr0f/statuses/116494731620227194https://board.circlewithadot.net/post/https://infosec.exchange/users/nerdpr0f/statuses/116494731620227194Thu, 30 Apr 2026 17:02:16 GMT<![CDATA[Reply to i bet you can already picture my 'why knowing basic networking and self hosting is important' tirade on Thu, 30 Apr 2026 17:01:13 GMT]]>@h2onolan @nerdpr0f https://www.youtube.com/watch?v=pJG5q0CLGys

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/Viss/statuses/116494727487212939https://board.circlewithadot.net/post/https://mastodon.social/users/Viss/statuses/116494727487212939Thu, 30 Apr 2026 17:01:13 GMT<![CDATA[Reply to i bet you can already picture my 'why knowing basic networking and self hosting is important' tirade on Thu, 30 Apr 2026 17:00:12 GMT]]>@nerdpr0f @Viss shut up you

]]>https://board.circlewithadot.net/post/https://infosec.exchange/users/h2onolan/statuses/116494723459350715https://board.circlewithadot.net/post/https://infosec.exchange/users/h2onolan/statuses/116494723459350715Thu, 30 Apr 2026 17:00:12 GMT<![CDATA[Reply to i bet you can already picture my 'why knowing basic networking and self hosting is important' tirade on Thu, 30 Apr 2026 16:59:57 GMT]]>@nerdpr0f 100% - its coming. and when that shit lands, there's gonna be a massive massive run on gpus, because if you have any of the X090 cards (i have a 3090ti for example) they have 24gig of vram, which is enough to run the larger 120b models, and if you can wrap say, qwen or deepseek or gpt-oss:120b with a decent enough harness, you can get 80% of frontier model functionality at home

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/Viss/statuses/116494722472252826https://board.circlewithadot.net/post/https://mastodon.social/users/Viss/statuses/116494722472252826Thu, 30 Apr 2026 16:59:57 GMT<![CDATA[Reply to i bet you can already picture my 'why knowing basic networking and self hosting is important' tirade on Thu, 30 Apr 2026 16:58:42 GMT]]>@Viss I just had a deeply cursed thought. AI manufacturers block queries covering specialized support knowledge (COBOL, FORTRAN, etc) and roll it ought under a "Legacy Systems Support" license that costs slightly less than what the consultants in this space bill for.

]]>https://board.circlewithadot.net/post/https://infosec.exchange/users/nerdpr0f/statuses/116494717594099916https://board.circlewithadot.net/post/https://infosec.exchange/users/nerdpr0f/statuses/116494717594099916Thu, 30 Apr 2026 16:58:42 GMT