[LON-CAPA-admin] [External] how to remove old lonUsers data?

[Kortemeyer, Gerd]

Hi,

Yes, that’s very true, you get inconsistencies in the data.

Saving the data has never been a real problem: Moore’s Law is exponential, while the accrual of user data is linear.

Best,

- Gerd.

> On Sep 30, 2024, at 18:12, Lucas, Mark via LON-CAPA-admin <lon-capa-admin at mail.lon-capa.org> wrote:
> 
> Todd,
> 
> Just as a caveat, each course also has a directory under lonUsers.
> It is not just users.
> 
> If you are removing everything that hasn’t been touched for 1000 days,
> you are probably also removing courses older than 1000 days. You may
> also remove portions of courses in ways that may cause errors if you
> access the partially removed old courses.
> 
> Mark
> 
>> On Sep 30, 2024, at 12:01 PM, Lars via LON-CAPA-admin <lon-capa-admin at mail.lon-capa.org> wrote:
>> 
>> Use caution with links and attachments.
>> 
>> Hi Todd,
>> 
>> They are just user files, so I don't see them affecting how lon-capa
>> runs. We haven't seen any problems.
>> 
>> Sincerely,
>> Lars.
>> 
>> On Mon, Sep 30, 2024 at 8:53 AM Todd Pfaff <pfaff at rhpcs.mcmaster.ca> wrote:
>>> 
>>> Thanks, Lars.  This is essentially what I was wondering: is it safe to
>>> simply selectively remove old files under lonUsers.  Given what you're
>>> doing, I guess the answer is "yes".
>>> 
>>> Todd
>>> 
>>> On Sun, 29 Sep 2024, Lars wrote:
>>> 
>>>> Hi Tod,
>>>> 
>>>> We have used this command to wipe out directories containing only
>>>> files older than 1000 days:
>>>> 
>>>> Enter on command line in /home/httpd/lonUsers/tmcc/* to erase student
>>>> directories in which every file is older than 1000 days:
>>>> 
>>>> for d in ./*; do find "$d" -mindepth 0 -mtime -1000 -print -quit |
>>>> grep -q . || echo rm -rf "$d"; done
>>>> 
>>>> Remove the echo when satisfied. Remove the -q to find out why a
>>>> directory is not being removed.
>>>> 
>>>> Sincerely,
>>>> Lars.
>>>> 
>>>> On Sun, Sep 29, 2024 at 3:44 PM Todd Pfaff via LON-CAPA-admin
>>>> <lon-capa-admin at mail.lon-capa.org> wrote:
>>>>> 
>>>>> Our lonUsers directory tree has grown to several hundred gigabytes with
>>>>> data from the past decade or so.  We'd like to be able to discard some of
>>>>> the older data that is no longer needed, but there doesn't seem to be any
>>>>> obvious or documented method for doing this sort of operation.
>>>>> 
>>>>> How does on go about safely removing old lonUsers data?
>>>>> 
>>>>> Thanks,
>>>>> Todd
>>>>> _______________________________________________
>>>>> LON-CAPA-admin mailing list
>>>>> LON-CAPA-admin at mail.lon-capa.org
>>>>> http://mail.lon-capa.org/mailman/listinfo/lon-capa-admin
>>>> 
>>>> --
>>>> 
>>>> 
>>>> --
>>>> 
>>>> *Public Records Notice:* In accordance with Nevada Revised Statutes
>>>> (NRS) Chapter 239, this email and responses, unless otherwise made
>>>> confidential by law, may be subject to the Nevada Public Records laws and
>>>> may be disclosed to the public upon request.
>>>> 
>>>> 
>> 
>> --
>> 
>> 
>> --
>> 
>> *Public Records Notice:* In accordance with Nevada Revised Statutes
>> (NRS) Chapter 239, this email and responses, unless otherwise made
>> confidential by law, may be subject to the Nevada Public Records laws and
>> may be disclosed to the public upon request.
>> _______________________________________________
>> LON-CAPA-admin mailing list
>> LON-CAPA-admin at mail.lon-capa.org
>> http://mail.lon-capa.org/mailman/listinfo/lon-capa-admin
> 
> --
> Mark Lucas
> Professor of Instruction
> Department of Physics and Astronomy (College of Arts and Sciences)/Ohio Honors Program (Honors College)
> 270 Clippinger Lab, Ohio University, Athens, OH 45701
> email: lucasm at ohio.edu
> phone: (740)597-2984
> Pronouns: He, Him, His
> 
> 
> 
> 
> 
> 
> 
> 
> _______________________________________________
> LON-CAPA-admin mailing list
> LON-CAPA-admin at mail.lon-capa.org
> http://mail.lon-capa.org/mailman/listinfo/lon-capa-admin

--
Gerd Kortemeyer, Ph.D.
Rectorate and AI Center, ETH Zurich
Associate Professor Emeritus, Michigan State University
Mobile (ETH business): +41 79 123 82 80
Mobile (private): +1 517 282 6446
https://gerdkortemeyer.com/