I ran the testthat tests but forgot to run devtools::check(). Somehow the options are handled differently in both cases.
testthat
devtools::check()