Flux is a refreshing approach to machine learning. It provides lightweight abstractions on top of Julia's native GPU and AD support, while remaining fully hackable (right down to the GPU kernels).
julia> Pkg.add("Flux")
See the documentation or the model zoo for examples.