Lower case _small capitals with macron_ of vowels are replaced by lower case _regular letters with macron_. I have tested some but not all fonts of the typeface but I assume that this applies to all fonts of Libertinus. I have not checked all diacritics but I have only found this issue with macrons.
Therefore, I kindly would like to get my mistake pointed out or an addition of lower case small capitals to all fonts of the Libertinus typeface.
Compile
\documentclass{memoir}
\usepackage{fontspec}\setmainfont{LibertinusSerif-Regular.otf}
\usepackage{unicode-math}\setmathfont{LibertinusMath-Regular.otf}
\begin{document}
\textsc{A膧 a膩 E膾 e膿 I莫 i墨 O艑 o艒 U弄 u奴} (does not work)
A膧 a膩 E膾 e膿 I莫 i墨 O艑 o艒 U弄 u奴 (for comparison)
\={\textsc{a}}\={\textsc{e}}\={\textsc{i}}\={\textsc{o}}\={\textsc{u}} \textsc{\=a\=e\=i\=o\=u} (does not work)
\textsc L$\bar{\textsc{u}}$\textsc t$\bar{\textsc{e}}$\textsc x (dirty math trick)
\textsc{Lutex}
\end{document}
with LuaLaTeX or XeLaTeX to get

I use TeX Live 2019 (frozen) and I have manually installed Libertinus 6.11.
_Thank you very much for this beautiful and versatile typeface._
Try the following for comparison:
\documentclass{article}
\begin{document}
\begin{tabular}{ll}
\verb+\textsc{A 膧 a 膩}+ & \textsc{A 膧 a 膩} \\
\verb+\textsc{E 膾 e 膿}+ & \textsc{E 膾 e 膿} \\
\verb+\textsc{I 莫 i 墨}+ & \textsc{I 莫 i 墨} \\
\verb+\textsc{O 艑 o 艒}+ & \textsc{O 艑 o 艒} \\
\verb+\textsc{U 弄 u 奴}+ & \textsc{U 弄 u 奴} \\
\verb+\textsc{Y 炔 y 瘸}+ & \textsc{Y 炔 y 瘸}\\
& \\
\verb+\={\textsc{a}}+ & \={\textsc{a}} \\
\verb+\={\textsc{e}}+ & \={\textsc{e}} \\
\verb+\={\textsc{i}}+ & \={\textsc{i}} \\
\verb+\={\textsc{o}}+ & \={\textsc{o}} \\
\verb+\={\textsc{u}}+ & \={\textsc{u}} \\
\verb+\={\textsc{y}}+ & \={\textsc{y}} \\
& \\
\verb+\textsc{\=a}+ & \textsc{\=a} \\
\verb+\textsc{\=e}+ & \textsc{\=e} \\
\verb+\textsc{\=i}+ & \textsc{\=i} \\
\verb+\textsc{\=o}+ & \textsc{\=o} \\
\verb+\textsc{\=u}+ & \textsc{\=u} \\
\verb+\textsc{\=y}+ & \textsc{\=y} \\
\end{tabular}
\end{document}
output with lualatex: lualatex.pdf
output with pdflatex: pdflatex.pdf
output with xelatex: xelatex.pdf
Currently smallcaps cover only a small subset of Latin glyphs, and it is quite some work to extend them. Contributions are welcome, but I won鈥檛 be able to work on it, sorry.
A workaround would be forcing the decomposed form of the characters using CGJ:
\documentclass{memoir}
\usepackage{fontspec}\setmainfont{LibertinusSerif-Regular.otf}
\usepackage{unicode-math}\setmathfont{LibertinusMath-Regular.otf}
\usepackage{newunicodechar}
\def\=#1{#1^^^34f^^^304}
\newunicodechar{膩}{\=a}
\newunicodechar{膿}{\=e}
\newunicodechar{墨}{\=i}
\newunicodechar{艒}{\=o}
\newunicodechar{奴}{\=u}
\begin{document}
\textsc{A膧 a膩 E膾 e膿 I莫 i墨 O艑 o艒 U弄 u奴} (does not work)
A膧 a膩 E膾 e膿 I莫 i墨 O艑 o艒 U弄 u奴 (for comparison)
\={\textsc{a}}\={\textsc{e}}\={\textsc{i}}\={\textsc{o}}\={\textsc{u}} \textsc{\=a\=e\=i\=o\=u} (does not work)
\textsc L$\bar{\textsc{u}}$\textsc t$\bar{\textsc{e}}$\textsc x (dirty math trick)
\textsc{Lutex}
\end{document}

After posting the above comment, I realized I can do the decomposition in the font, so this is done now and the above workaround is no longer needed.
Most helpful comment
After posting the above comment, I realized I can do the decomposition in the font, so this is done now and the above workaround is no longer needed.