A Walk on the Wild Side

ASM Chapter 4

code

julia

statistics

asm

ecology

We turn to Chapter 4 of Applied Statistical Modelling for Ecologists, by Marc Kéry and Kenneth Kellner. In this chapter we turn to a comparison of different statistical…

Alun ap Rhisiart

ASM Chapter 3

code

julia

statistics

asm

ecology

Applied Statistical Modelling for Ecologists (ASM) by Marc Kéry & Kenneth F. Kellner is a fantastic resource for quantitative ecologists looking to deepen their…

Alun ap Rhisiart

Building LoRA Models

code

ml

huggingface

nlp

python

pyspark

databricks

Since 2021 LoRA methods and derivatives (such as QLora, IA3, etc) have become more common. Fine-tuning a BERT or decoder model, even though much better than training from…

Dr Alun ap Rhisiart

Stratified train-test-split

code

julia

data cleaning

data engineering

I previously wrote some Julia code to do a train-test-split with the train dataset also split to train/validation. However, I wanted to improve on this by making a…

Dr Alun ap Rhisiart

Dealing with multi-class ML data

code

julia

ml

data cleaning

data engineering

For the purpose of child safeguarding, one thing I do is build NLP models that classify texts according to certain risk categories (eating disorders, suicide ideation…

Dr Alun ap Rhisiart

A Walk on the Wild Side

new

In my work, I use a variety of languages, principally SQL, Julia, Python, and R, and a variety of tools, such as Databricks, dbt, Prefect, Jupyter Lab, VS Code, RStudio, and…

Alun ap Rhisiart