Root "eats MB's", OS have no space, server down, l

sanderrrrrr · - Joined: 10 Feb 2004 Posts: 28

Hi,

I'm running Abyss for one year now and I'm very happy about it. And I still am :)
Now I gain more and more visitors and this problem showed up:

I'm running Win 98SE, abyss 1.2.2.2, PHP, MySQL and Perl.
Server Parameter: Extended Logging Format --> YES

At my root dir (C:\) There is, after a boot, 100MB free diskspace. After 2 or 3 days (50 or 70 visitors) there are only a few KB's left.
Then, ofcourse, the server gets unstable, Abyss gets CENSORED-up, reboot itselves (very nice) and works again. After this senario, Abyss does not log anymore sometimes.
This is, I think, becouse Abyss logs a couple weared lines in the log-file. After I delete that lines, Abyss does log again.

So, my question is: why is something eating my diskspace or/and, why does Abyss damage the log file? How can I resolve it?

Tnks

jmoschetti45 · - Joined: 29 Oct 2003 Posts: 95 Location: MI USA

I have a very similar problem. It's just not as fast. Without downloading or installing anything in the past month I have noticed a 1.2GB drop in free space. I delete temporary files and everything to gain back about 150MB but im still missing a lot of space. At this rate I will be out of space in 2 months. Anyone know whats happening?
_________________
http://jmoschetti45.com

iNaNimAtE · Posted: Sat Mar 27, 2004 8:37 pm Post subject:

Can you show me your logs? Or at least an excerpt?

I'll bet you there are many worms trying some old IIS exploits, and some other people trying randodm directory names. Also, what is the size of the log? If it is a couple hundred MB, then you have your problem. If it is only a couple KB, then you have a different problem.
_________________
Bienvenidos!

TRUSTAbyss · - Joined: 29 Oct 2003 Posts: 3752 Location: USA, GA

As your abyss log file gets bigger , your hard drive will start to lose
more and more space , you should erase the line for logging inside
the abyss web server console or try abyss restarter at www.billanddot.com

iNaNimAtE · Posted: Sat Mar 27, 2004 8:49 pm Post subject:

The problem is, it may not be the logs. I've never seen a 100MB log before.
_________________
Bienvenidos!

TRUSTAbyss · - Joined: 29 Oct 2003 Posts: 3752 Location: USA, GA

dude , he's taking about 1 Full year!

just to let you know , if you try and delete
the abyss log file when its running , that
space still exists , if you don't believe me
browse back to your site and check your log
and you will find a whole lot of white space.

jmoschetti45 · - Joined: 29 Oct 2003 Posts: 95 Location: MI USA

No it's not my log. It's only 12.7MB. But this problem has only been occuring since I installed Abyss.
_________________
http://jmoschetti45.com

TRUSTAbyss · - Joined: 29 Oct 2003 Posts: 3752 Location: USA, GA

Do you have a router and some sort of other
server running besides Abyss Web Server ?

jmoschetti45 · - Joined: 29 Oct 2003 Posts: 95 Location: MI USA

Yes I have a router but thats it. No FTP or mail servers yet.
_________________
http://jmoschetti45.com

TRUSTAbyss · - Joined: 29 Oct 2003 Posts: 3752 Location: USA, GA

ok , do you have logging enabled on your router ?

jmoschetti45 · - Joined: 29 Oct 2003 Posts: 95 Location: MI USA

Yes. Its not that log file either. That one is 44MB.
_________________
http://jmoschetti45.com

iNaNimAtE · Posted: Sun Mar 28, 2004 6:23 am Post subject:

Where did he say anything about a year?
_________________
Bienvenidos!

jmoschetti45 · - Joined: 29 Oct 2003 Posts: 95 Location: MI USA

I never did. I said I lose about 1.2GB per month.
_________________
http://jmoschetti45.com

iNaNimAtE · Posted: Sun Mar 28, 2004 6:39 am Post subject:

Yeah... TRUSTPunk mentioned something about someone saying a year.
_________________
Bienvenidos!

sanderrrrrr · - Joined: 10 Feb 2004 Posts: 28

I was mentioning something about 1 year (TS).

Abyss is installed at the C-disk. My logfile is 6 Mb and on the D-disk. So I let Abyss log on another disk.

I have also running a FTP server but The only one who use it, is me. Once in two weeks or something.

I noticed that, If I visit my stats (AWstats, perl), I suddenly lose 10 Mb free diskspace. So I thought it was perl whitch was the evil part. But If I don't use perl scripts, I still lose diskspace.

(I will post the bad-lines of my logs at the next forced-reboot of my server)

Tnks.

TRUSTAbyss · - Joined: 29 Oct 2003 Posts: 3752 Location: USA, GA

I was talking about sanderror's issue , sorry about that ! :oops:

aprelium · - Joined: 22 Mar 2002 Posts: 6800

Abyss doesn't do such things :D We recommend checking your Temp directory (by default c:\windows\temp). Some badly designed Windows applications forget to remove their temporary files.
_________________
Support Team
Aprelium - http://www.aprelium.com

aprelium · - Joined: 22 Mar 2002 Posts: 6800

By the way, is your swap file on C:? It could be also the cause of this trouble.
_________________
Support Team
Aprelium - http://www.aprelium.com

iNaNimAtE · Posted: Sun Mar 28, 2004 7:30 pm Post subject:

Windows uses a swapfile? Is that the "pagefile.sys" on the root directory?
_________________
Bienvenidos!

Anonymoose · - Joined: 09 Sep 2003 Posts: 2192

Install Treesize and see where all the space has gone...

http://www.jam-software.com/freeware/index.shtml

Omar G · Posted: Tue Mar 30, 2004 11:40 am Post subject: The Answer is this...

You are experiencing memory leakage! The swapfile is getting too large because of the leakage and takes up the slack from the memory. This is part of the operating system, since Win98 is not a server operating system. Win98 usually needs rebooting each day or two because it becomes unstable. Rebooting clears up the memory and returns the swap file to its "normal" size. If you really need to use Win98, buy more memory (first check to see the max memory your computer can hold...each is designed differently) or reboot each day for a smoother experience. BTW, your users may be experiencing agonzingly slow access times to your website once the swapfile gets too large...

- OmarG[/b]

sanderrrrrr · - Joined: 10 Feb 2004 Posts: 28

ok, A memory leakage ...

What if I try to limit virtual memory to 50 Mb? Less maybe, or more?Would this help?

I don't really need Win98 but, Xp won't work on a Pentium 2, 500Mb HD 32 RAM .. I think. I also have Linux 9.0 somewhere in the dust.

I have to reboot my server now, becouse I changed the limit for my Virtual Memory ... I have to wait becouse I'm not gonna reboot when there are visitors at my server :)

(I thought I had already tried this, but I tried so much so I can be wrong)

iNaNimAtE · Posted: Wed Mar 31, 2004 1:24 am Post subject:

Yes, Windows XP requires 128MB of ram or more.

If you do a search, you can probably find an application that will restart your computer at certain intervals (like 2AM in the morning every other day).
_________________
Bienvenidos!

Omar G · Posted: Wed Mar 31, 2004 4:19 am Post subject:

Sanderrrrr,

Limiting the virtual memory could destabalize your machine, or at the leat, seriously slow it down. If you have Linux, why not try it out? Any distro of Linux is very suitable to use as a server for a computer such as yours, since XP requires more memory. Abyss does have a Linux version, BTW.

- OmarG

sanderrrrrr · - Joined: 10 Feb 2004 Posts: 28

Abyss is also available for linux (http://www.aprelium.com/abyssws/download.php, the 3rd link).

If I install Linux, I have to download a linux versin for all of my programs, maybe i do tat some time .... when I have a long period nothing to do.

I still haven't reboot my server :) .. it is running for 3 days now without the space-problems. Let's see how long it takes.

I think the best solution for now is to download that reboot aplication. I never thought about it by the way, so tnks :D

Toadhead · - Joined: 01 Dec 2003 Posts: 21

Toadhead · - Joined: 01 Dec 2003 Posts: 21

eh....does anyone have an idea how to clear such big file?

In the most text editos were I open it in like Notepad or wordpad I will get an erro message: The file is too big to be opened" or sometihng like that..

when I open it in Word2000 word is crashing :/

edited:

Doesn't matter anymore...I already deleted the 5 GIG big file :P
"error, this file to too big for the trashcan" :?

TRUSTAbyss · - Joined: 29 Oct 2003 Posts: 3752 Location: USA, GA

sanderrrrrr · - Joined: 10 Feb 2004 Posts: 28

TRUSTAbyss · - Joined: 29 Oct 2003 Posts: 3752 Location: USA, GA

The owner of that website is like a friend of mine and I
submit new feature ideas to that person so what happens
is that I asked for a version that can extract my local IP'S
from my abyss logs after they have been split , just incase
another IP Address from my lan doesn't get extracted. So
if you was to download "IP-Line Deleter" and "Abyss Restarter"

You could have an option to delete more IP's later !

goose · Posted: Fri Apr 02, 2004 4:26 pm Post subject:

hmm some interesting freeware tools hehe :lol:
_________________
living in an armish paradise.....no gates here!

mawuahahaha :)

jmoschetti45 · - Joined: 29 Oct 2003 Posts: 95 Location: MI USA

Well I found most of that useful (especially the tools), but this morning when I got up I noticed a box saying C:\ had 0 bytes (yes, bytes) free!! Now my server is down, and my computer doesn't boot. Before I do a 'format C:' I'd prefer to know whats going wrong here so I don't have the problem again. I only lose space while Abyss is running. And at a rate of 1.4MB an hour too :cry:
_________________
http://jmoschetti45.com

iNaNimAtE · Posted: Tue Apr 06, 2004 12:30 am Post subject:

Now can you actually account for the space; meaning do you actually see 1.4MB of log entries?

Windows is known to mess up both their time estimation and their file statistics.
_________________
Bienvenidos!

jmoschetti45 · - Joined: 29 Oct 2003 Posts: 95 Location: MI USA

Nope. It's not the swap file, not the temp dir, and not the Abyss log. The only thing thats taking up a considerable amount of space is C:\_restore but its only 2.48GB and it hasn't grown at all in over 3 months. Im going to boot into DOS and kill that so my server will run for a while again (but not that long).
_________________
http://jmoschetti45.com

iNaNimAtE · Posted: Tue Apr 06, 2004 3:32 am Post subject:

Well I suggest unhiding all files, and keep a tally of how much space each folder takes up. (In your C: root). Go into each folder and narrow it down from there. You might find something interesting.

Also, empty your recycle bin. I've gotten 2GB back from that once.
_________________
Bienvenidos!

Anonymoose · - Joined: 09 Sep 2003 Posts: 2192

Have you tried the Treesize program I suggested? That removes the need to manually check each folders size as it will produce Windows explorer style output with folder size against each folder in the tree.

Are you sure your swap file and log file aren't growing ? If Abyss is losing 1.4mb an hour then you must either have a hell of a lot of hits rapidly filling up the log or a nasty memory leak somewhere that's forcing up the size of your pagefile.

Fex · - Joined: 07 Apr 2004 Posts: 17 Location: New Zealand

Am, why are you running a web server on Windows 98SE? And how come you only have 100MB?

Shouldn't you be running say Windows 2000 Advanced Server, Linux, Windows 2003 or something like that? With Gigs and Gigs of space?

sanderrrrrr · - Joined: 10 Feb 2004 Posts: 28

Hehe, you won :wink:

I have to use linux or win 2000, I know it's better. But it takes a lot of time to fix it, time what I don't have this period.

In two months, I am free and will install another OS.
I'm by the way not sure which OS I will install.

And all those Gigs I don't have? ... Well I have to steal another HD somewere I think :? :wink:

iNaNimAtE · Posted: Thu Apr 08, 2004 2:13 am Post subject:

If you are already a Windows Guru, I suggest sticking with Windows. It will save you a lot of time on the transition. (If you tried Linux, I'm sure problems would arise).
_________________
Bienvenidos!

TRUSTAbyss · - Joined: 29 Oct 2003 Posts: 3752 Location: USA, GA

If you was to switch to linux , get ready to
do alot of CHMOD on your CGI scripts lol

jmoschetti45 · - Joined: 29 Oct 2003 Posts: 95 Location: MI USA

I also reccomend staying with Windows if you haven't used linux. Yes I've used the TreeSize program. Found nothing unusual with it. After doing that I bothered to click on C:\ in My Computer and was very supprised/shocked. My hard drive is 'deteriorating'. It used to have a capacity of about 76GB. Now its down to 54GB (and slowly shrinking). Seems to me like the format or partition is going bad?? Is that even possible?? Im wiping the partition and reformating it while im writing this post. Wasn't able to back everything up though, just the important stuff :cry:
_________________
http://jmoschetti45.com

sanderrrrrr · - Joined: 10 Feb 2004 Posts: 28

A bit offtopic:
ok, Let's stick with windows. I have here on my desk:
-Win 89SE (not an option)
-Win ME
-Win 2000 (well, somewhere, but can't find it)
-Win XP

My HD is 500 Mb. If it is not enough, I have a 1.2 Gb HD.
If the OS only takes (minimum install) 250 MB, I will use the 500 Mb HD for my root. Else I have to use the other one (the other one is now the one with all my webpages, documents, logs, etc.).

So, tell me, wich one is the best. Wich one is going to win :)

jmoschetti45 · - Joined: 29 Oct 2003 Posts: 95 Location: MI USA

Since you'll be using the computer primarily as a server I reccomend Windows 2000 if you can find it. If not then use Windows XP. For the two hard drives, make the 500MB one C:\ and put Windows on it, and make the 1.2GB one D:\ and put your site files on it.
_________________
http://jmoschetti45.com

Anonymoose · - Joined: 09 Sep 2003 Posts: 2192

You won't fit a fresh Windows XP install into 500mb :(

sanderrrrrr · - Joined: 10 Feb 2004 Posts: 28

jmoschetti45 · - Joined: 29 Oct 2003 Posts: 95 Location: MI USA

If you do a custom install you should be able to. Just uncheck everything except the vital components.
_________________
http://jmoschetti45.com

sanderrrrrr · - Joined: 10 Feb 2004 Posts: 28

Anonymoose · - Joined: 09 Sep 2003 Posts: 2192

Even a minimal install with everything unticked will still top 500mb, a basic install with standard options is around 1gb, you won't shave that off in unticking things. You can get it lower by tweaking the CD before the install, but you won't get less than 500mb from a standard XP disk...

iNaNimAtE · Posted: Thu Apr 08, 2004 9:16 pm Post subject:

I would actually do the opposite of what jmoschetti45 said. Make the 1.2GB the C: drive, and put all your /htdocs directory on your D: drive (the 500MB). You will be able to get Windows on to the 1.2GB, and have enough room on either the C: or D: to install PHP, Perl, et cetera.
_________________
Bienvenidos!

Trix · - Joined: 03 Apr 2003 Posts: 33

are you sure you didn't get rooted? the person could be uploading stuff to a folder in the windows dir and serving it in an irc chan!