Where can I get a Recent-Git-Build of FreeBASIC?

For other topics related to the FreeBASIC project or its community.
fxm
Moderator
Posts: 10639
Joined: Apr 22, 2009 12:46
Location: Paris suburbs, FRANCE

Re: Where can I get a Recent-Git-Build of FreeBASIC?

Postby fxm » Oct 07, 2021 20:17

Indeed:
fxm wrote:For some time now, I have noticed that access times to Wiki are sometimes becoming very long.
Then it seems to me that if we are logged in, the access times become correct again.
Is it just a combination of circumstances ?

badidea wrote:It is indeed slow. Now I even get:

Request Timeout
This request takes too long to process, it is timed out by the server. If it should not be timed out, please contact administrator of this web site to increase 'Connection Timeout'.

fxm wrote:
fxm wrote:For some time now, I have noticed that access times to Wiki are sometimes becoming very long.
Then it seems to me that if we are logged in, the access times become correct again.
Is it just a combination of circumstances ?

I confirm my remark in red.
St_W
Posts: 1526
Joined: Feb 11, 2009 14:24
Location: Austria
Contact:

Re: Where can I get a Recent-Git-Build of FreeBASIC?

Postby St_W » Oct 07, 2021 20:27

I just tried whether it gets better after logging in, but unfortunately can't confirm your observations; for me it's still as slow as when not being logged in. Also I'm not sure how to integrate that login in the check, as the URL Trigger Jenkins plugin (https://plugins.jenkins.io/urltrigger/) just supports Basic Auth, but no complex login flows.
adeyblue
Posts: 94
Joined: Nov 07, 2019 20:08

Re: Where can I get a Recent-Git-Build of FreeBASIC?

Postby adeyblue » Oct 07, 2021 21:27

I don't want to say the wiki isn't the greatest piece of software, but the css file that's specified in the header of the recent changes xml file does this:
Image
That url in full is 16,418 characters long!
fxm
Moderator
Posts: 10639
Joined: Apr 22, 2009 12:46
Location: Paris suburbs, FRANCE

Re: Where can I get a Recent-Git-Build of FreeBASIC?

Postby fxm » Oct 07, 2021 21:49

fxm wrote:
fxm wrote:For some time now, I have noticed that access times to Wiki are sometimes becoming very long.
Then it seems to me that if we are logged in, the access times become correct again.
Is it just a combination of circumstances ?

I confirm my remark in red.

Similar remark when accessing: https://www.freebasic.net/wiki/wikka.php?wakka=RecentChanges/recentchanges.xml
'Livemarks' extension (restores dynamic RSS bookmarks) only works when I am logged in.
fxm
Moderator
Posts: 10639
Joined: Apr 22, 2009 12:46
Location: Paris suburbs, FRANCE

Re: Where can I get a Recent-Git-Build of FreeBASIC?

Postby fxm » Oct 08, 2021 6:56

This night the manual update worked.
Did you do something ?
St_W
Posts: 1526
Joined: Feb 11, 2009 14:24
Location: Austria
Contact:

Re: Where can I get a Recent-Git-Build of FreeBASIC?

Postby St_W » Oct 08, 2021 11:11

no, didn't change anything
fxm
Moderator
Posts: 10639
Joined: Apr 22, 2009 12:46
Location: Paris suburbs, FRANCE

Re: Where can I get a Recent-Git-Build of FreeBASIC?

Postby fxm » Oct 08, 2021 11:16

You were very lucky, because currently the access times are very long (without being logged in).
coderJeff
Site Admin
Posts: 3644
Joined: Nov 04, 2005 14:23
Location: Ontario, Canada
Contact:

Re: Where can I get a Recent-Git-Build of FreeBASIC?

Postby coderJeff » Oct 09, 2021 9:29

adeyblue wrote:That url in full is 16,418 characters long!

The URL rewrite in '.htaccess' was not getting along with the redirects in the wiki app resulting in a never ending request. I've prevented it from happening in this case by changing the URL rewrite rules in .htaccess. That's the best I can do for now.

fxm wrote:You were very lucky, because currently the access times are very long (without being logged in).

I noticed this too. Up to 40s not logged in. When I'm logged in typically under 1s. I couldn't reproduce the problem on my local server, though. I'm guessing a poorly constructed query or search when no user is logged in.

St_W wrote:no, didn't change anything

Maybe I asked before and forgot: what is your method for polling changes on the wiki and fetching updates?
St_W
Posts: 1526
Joined: Feb 11, 2009 14:24
Location: Austria
Contact:

Re: Where can I get a Recent-Git-Build of FreeBASIC?

Postby St_W » Oct 10, 2021 12:22

coderJeff wrote:what is your method for polling changes on the wiki and fetching updates?
This is the configuration I'm currently using for the UrlTrigger Jenkins Plugin:
Image
This fetches "https://freebasic.net/wiki/wikka.php?wakka=RecentChanges/recentchanges.xml" and extracts the change date via XPath expression //pubDate[1]. When the content (result of evaluating XPath expression) changes a new build is triggered. If there's an easier way to check for wiki changes programmatically (or even something like push notifications) I'll happily implement/use that.
coderJeff
Site Admin
Posts: 3644
Joined: Nov 04, 2005 14:23
Location: Ontario, Canada
Contact:

Re: Where can I get a Recent-Git-Build of FreeBASIC?

Postby coderJeff » Oct 10, 2021 17:55

St_W wrote: If there's an easier way to check for wiki changes programmatically (or even something like push notifications) I'll happily implement/use that.

Do you then fetch only the changed pages? Or you fetch everything?

I have worked on something, but I don't quite have a full solution yet.
When working with the wiki there are 2 things that are very slow for me:
- fetching a full page index (currently page names are extracted from the HTML)
- A manual step to fetch only the changed pages. And if I lose track, I have to fetch the whole wiki. Like when doing wiki snapshots to commit to the fbc repository.

So, my idea is to keep a local copy of the index for wakka pages I already have. Then fetch a new copy of the index and scan for pages that have been revised by checking the revision numbers.

I just added fbwikka: custom handler for 'rawlist' #1
See the results: RecentChanges/rawlist&format=index

Could this be helpful to you?
coderJeff
Site Admin
Posts: 3644
Joined: Nov 04, 2005 14:23
Location: Ontario, Canada
Contact:

Re: Where can I get a Recent-Git-Build of FreeBASIC?

Postby coderJeff » Oct 10, 2021 22:40

fxm wrote:
fxm wrote:
fxm wrote:For some time now, I have noticed that access times to Wiki are sometimes becoming very long.
Then it seems to me that if we are logged in, the access times become correct again.
Is it just a combination of circumstances ?

I confirm my remark in red.


If no user is logged in, the wiki app does a host look up on the IP address. I've disabled this feature in the wiki app and page load times should be much quicker.
fxm
Moderator
Posts: 10639
Joined: Apr 22, 2009 12:46
Location: Paris suburbs, FRANCE

Re: Where can I get a Recent-Git-Build of FreeBASIC?

Postby fxm » Oct 11, 2021 9:19

Sure enough, it's perfect now :-)
St_W
Posts: 1526
Joined: Feb 11, 2009 14:24
Location: Austria
Contact:

Re: Where can I get a Recent-Git-Build of FreeBASIC?

Postby St_W » Oct 11, 2021 15:05

coderJeff wrote:[...] So, my idea is to keep a local copy of the index for wakka pages I already have. Then fetch a new copy of the index and scan for pages that have been revised by checking the revision numbers.
Thanks, didn't know about this API endpoint. That sounds very useful, especially for the fbdoc tool, making the fetching a lot easier (no HTML parsing) and faster (only fetch changed pages). Saw you are already working on some changes there. Let me know if I can help anywhere.

Regarding the change polling the new endpoint could be used as well, but currently also the RSS feed seems to be as fast, so I don't really see a reason for change for now (and the RSS page is smaller to fetch compared to the whole revision index table).

coderJeff wrote:If no user is logged in, the wiki app does a host look up on the IP address. I've disabled this feature in the wiki app and page load times should be much quicker.
Thanks, that seems to improve things a lot (and not sure why it should do a host lookup - just for info in the footer? IMHO that could be removed altogether)

Return to “Community Discussion”

Who is online

Users browsing this forum: No registered users and 4 guests