Search found 274 matches

by Luxan
Apr 04, 2025 4:14
Forum: Libraries & Headers
Topic: Fast Artificial Neural Network (FANN) Library
Replies: 5
Views: 4380

Re: Fast Artificial Neural Network (FANN) Library

What happened to this project, is the library and freebasic .bi file still available.

Reading elsewhere some more recent posts about this project, bugs were encountered.
by Luxan
Apr 04, 2025 1:55
Forum: Beginners
Topic: Neural Networks 1
Replies: 20
Views: 6412

Re: Neural Networks 1

Interesting result when training, then testing, via python3 with torch. Indicates that once the Average Loss reaches a particular value, the NN will faithfully perform 4bit signed multiplication. We're also using thresholding after the NN output. The NN structure is: 8,128,16,8 and the activation fu...
by Luxan
Mar 31, 2025 20:01
Forum: Community Discussion
Topic: ChatGPT + FreeBASIC
Replies: 32
Views: 10605

Re: ChatGPT + FreeBASIC

Just ran ollama run qwen2.5-coder:1.5b this is fairly smooth, producing sensible freebasic code and glsl code that may also be sensible. At the moment these are just small pieces of code. If this is running completely upon my PC then this is remarkable. The only discomfort is over copyright, Alibaba...
by Luxan
Mar 31, 2025 7:38
Forum: Community Discussion
Topic: ChatGPT + FreeBASIC
Replies: 32
Views: 10605

Re: ChatGPT + FreeBASIC

There's also freebasic documentation as a text file, in zip format, that's available. I managed to install ollama, that runs a selection known as a manifest from various A.I groups, this has the ability to use VRAM and system RAM, according to the brief note I read. CUDA acceleration is possible, te...
by Luxan
Mar 25, 2025 21:14
Forum: Community Discussion
Topic: ChatGPT + FreeBASIC
Replies: 32
Views: 10605

Re: ChatGPT + FreeBASIC

Okay, so some time has passed and there have been some developments, like DeepSeek. However, at the practical level I'm interested in an online ai chat client where I don't need to worry about what I develop being visible to others, Meta's llama models don't meet that criterion. Also, I don't want t...
by Luxan
Mar 23, 2025 4:10
Forum: Beginners
Topic: Neural Networks 1
Replies: 20
Views: 6412

Re: Neural Networks 1

Part of the larger project, this reads Neural Network weights and biases from a text file. I've used a pytorch equivalent of the freebasic Neural Network code, with some interesting results. From there I saved the weights and biases as a text file, the same should also be possible from the previous ...
by Luxan
Mar 11, 2025 7:43
Forum: Beginners
Topic: Neural Networks 1
Replies: 20
Views: 6412

Re: Neural Networks 1

Using this structure for the NN, I progress through the loss like this. Upon testing the NN, the Total Error: 0.01267549334836566, is quite good; however, it needs to be 0. More training epochs and a further tweak to the NN structure might get me there. Dim layer_sizes(4) As Integer = {8, 64, 16, 16...
by Luxan
Mar 07, 2025 16:38
Forum: Beginners
Topic: Neural Networks 1
Replies: 20
Views: 6412

Re: Neural Networks 1

This is the present status of the NN for logic emulation. The use of randomised shuffling of indexes for the input and corresponding training data is recommended. The Sigmoid activation function may not be optimal. Temporary storage of weights and biases in auxilary arrays, then copy back depending ...
by Luxan
Feb 24, 2025 3:31
Forum: Beginners
Topic: Neural Networks 1
Replies: 20
Views: 6412

Re: Neural Networks 1

Previous, valid for 4bit and 8bit signed integers
by Luxan
Feb 24, 2025 0:11
Forum: Beginners
Topic: Neural Networks 1
Replies: 20
Views: 6412

Re: Neural Networks 1

As usual, once I get a flood of feedback I start coding. I might also examine this for 8 bit signed integers, anyway here's the code. ' ' ---------------------------------------------------------------------- ' int_bit3.bas ' ' signed integer to binary representation ' and ' binary representation to...
by Luxan
Feb 23, 2025 22:19
Forum: Beginners
Topic: Neural Networks 1
Replies: 20
Views: 6412

Re: Neural Networks 1

This is what I'm attempting, illustrated via code. ' NN_Logic.bas ' ---------------------------------------------------------------------- ' ' NN for Logic simulation . ' ' sciwiseg@gmail.com ' ' ---------------------------------------------------------------------- ' screen 12 color 15,0 locate 2,2...
by Luxan
Feb 23, 2025 21:14
Forum: Beginners
Topic: Neural Networks 1
Replies: 20
Views: 6412

Re: Neural Networks 1

A somewhat, related piece of code, requiring improvement. The type of routine one might make into a standard library, if it doesn't already exist. 'declare sub int2bit(bsq as Matrix, x as uinteger, nb as integer) declare Function BitsToInt(bits() As UShort , size As Integer) As Integer declare funct...
by Luxan
Feb 12, 2025 22:23
Forum: Beginners
Topic: Neural Networks 1
Replies: 20
Views: 6412

Re: Neural Networks 1

This is in preparation for something other than logic gates, which don't always reach levels 0 or 1. You can always use the previous code when you're assuming a definite 0 or 1, off or on. The introduction of MSE loss during training might be useful even in that context. I appreciate the value of ke...
by Luxan
Feb 12, 2025 6:00
Forum: Beginners
Topic: Neural Networks 1
Replies: 20
Views: 6412

Re: Neural Networks 1

Being a hot evening at my location, my brain isn't ready for too much coding. So, I asked DeepSeek to improve upon the existing code, this is the result, you'll note that the inference stage uses inputs ranging from 0 to 2. /' DS_NN2b.bas (c) Copyright 2025, sciwiseg@gmail.com Extended FreeBasic Neu...
by Luxan
Feb 10, 2025 6:36
Forum: Beginners
Topic: Parser example problem
Replies: 20
Views: 4804

Re: Parser example problem

I wish you luck with this.

Some decades ago, I wrote a mathematical expression parser and evaluator,
written in a version of BASIC.

To construct this, I drew up Backus-Naur diagrams.
Even large exponents were catered for.

The code must be here somewhere.