Search Results

Introduction Here are the basics for new users of the High Performance Computing (HPC) offered by GRIT, including the basic tools needed to efficiently access and use the HPC systems and the software they run. The HPC Systems are (their operating system, RAM...

To use the new HPC Cluster The new HPC cluster is available via a GUI to the SLURM interface, which can be found here: https://hpc.grit.ucsb.edu/ Intro SLURM (Simple Linux Utility for Resource Management) is a widely used open-source job scheduler that we ...

Basic Rsync Usage rsync is a very powerful and widely used tool for moving data. The manual page has many useful examples (from the command line type "man rsync"). Here are a couple of examples to get you started: # the command format is #rsync <switch opt...

  Using Matlab via CLI Some options of interest: --nodesktop - skips firing up the desktop at startup (if java is running it can be fired up later) --nojvm - skip loading of Java, this means that no desktop can be started up --nosplash - skip trying to ...

"Anaconda is the hardware store of data science tools, Miniconda is the workbench (software distributions), Conda is the assistant (package manager) who helps you get new tools and customise your hardware store or workbench." (Instructions contributed by Es...

screen can be used when running jobs to allow you to disconnect your computer from a remote terminal session, for example when running a very long rsync job.    # (From a terminal command line): # create a new screen session screen -S    #name the session ...

Jupyter Web UI available at these addresses. Public https://hpc-01.grit.ucsb.edu/jupyter ✔️ https://forge.eri.ucsb.edu:8004/jupyter/hub/login ✔️ https://hammer.eri.ucsb.edu/jupyter/ ✔️

On a Mac, use Terminal  / On a PC, use PowerShell (run as administrator) or install WSL: https://learn.microsoft.com/en-us/windows/wsl/install Open a PowerShell window as an administrator and run the following command: ssh-keygen -t ecdsa Hit e...

We tend to install R with all the packages, so if you're finding one make sure that you are seeing the default install path.  To see the installed packages (from an R prompt): > installed.packages(); To find just one (one example of when it's there, another...

How to check file/folder permissions Anywhere the folder is mounted, view ACLs using getfacl: getfacl /path/to/file or ls -l /path/to/folder How to change file/folder permissions We should be changing permissions with extended attributes. On a ZFS filesystem...

Methods to share data/storage with collaborators:  https link (like in a public_html directory; publicly available)  Google Drive-like link sharing with NextCloud (allows sharing to groups or individuals) Rsyncd daemon (which requires the use of the comma...

From scratch Install mini conda https://docs.anaconda.com/miniconda/miniconda-install/ source ~/.bashrc Install the CDS API dependencies conda create --name cdsapi conda activate cdsapi conda install -c conda-forge cdsapi With this the steps to get a...

Using a remote desktop/XRDP to connect to an HPC desktop and then run jupyter in the browser for a long running job is becoming a common use case. OVERVIEW connect to the desktop with XRDP.  open Firefox and then logging into jupyter. If yo...

Scenario: you know some non-UCSB person who has data you want them to upload it to your GRIT storage. First, this feature is only enabled by GRIT staff for temporary use, but once it's enabled, here are the steps.   1) Click on the share icon for the folder...

WE RECOMMEND PYCHARM INSTEAD We have no shortage of issues with vscode working with the HPC servers via remote access. Microsoft is aware of these issues and there is no reliable fix for them yet. For python work we highly suggest pycharm (https://www.jetbrai...