Go: runtime/cgo: fails to build after updating to Mojave

[Elixworks]

What version of Go are you using (go version)?

go version go1.11 darwin/amd64
GOARCH="amd64"
GOBIN=""
GOCACHE="/Users/foo/Library/Caches/go-build"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="darwin"
GOOS="darwin"
GOPATH="/Volumes/DailySD/SD_Dev"
GOPROXY=""
GORACE=""
GOROOT="/usr/local/go"
GOTMPDIR=""
GOTOOLDIR="/usr/local/go/pkg/tool/darwin_amd64"
GCCGO="gccgo"
CC="clang"
CXX="clang++"
CGO_ENABLED="1"
GOMOD=""
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=/var/folders/fj/yby80m4x1pq1nzvfvd1hplhw0000gn/T/go-build110153853=/tmp/go-build -gno-record-gcc-switches -fno-common"

GCC

Configured with: --prefix=/Applications/Xcode.app/Contents/Developer/usr --with-gxx-include-dir=/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/include/c++/4.2.1
Apple LLVM version 10.0.0 (clang-1000.11.45.2)
Target: x86_64-apple-darwin18.0.0
Thread model: posix
InstalledDir: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin

What did you do?

update macOS to mojave,
install go, vscode for Developement.

An error that did not get offended when go test was done within an existing project occurred. It is below.

# runtime/cgo
_cgo_export.c:3:10: fatal error: 'stdlib.h' file not found

If possible, provide a recipe for reproducing the error.
A complete runnable program is good.
A link on play.golang.org is best.

What is missing, please help me.

[ianlancetaylor]

What, precisely, did you do?

[ianlancetaylor]

The error certainly looks like a problem with your xcode installation. It looks like your C compiler can not find the standard header files.

[Elixworks]

$ dlv debug
$ go test 

such errors, thx.

runtime/cgo

_cgo_export.c:3:10: fatal error: 'stdlib.h' file not found
exit status 2

$ sudo rm -rf /Library/Developer/CommandLineTools
$ xcode-select --install

But the error does not go away. TT

[ianlancetaylor]

What happens if you put this code into a file named hello.c and run clang hello.c?

#include <stdlib.h>
int main() { exit(0); }

[Elixworks]

hello.c:1:10: fatal error: 'stdlib.h' file not found
#include <stdlib.h>
         ^~~~~~~~~~
1 error generated.

done.

[ianlancetaylor]

OK, you need to fix that problem somehow. That is a problem with your C compiler. It is not a problem with Go. There is nothing that we can change in the Go tools to fix that. Unfortunately I have no idea what the problem is. I'm going to close this issue since there is nothing we can do. Please comment if you disagree.

[wujunze]

Me too @Elixworks

[wujunze]

You can try xcode-select --install

[fredcarle]

I have the same issue and xcode-select --install did not solve the problem

[fredcarle]

Found the solution with this one

[mimoo]

open /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg

[mrtuborg]

@mimoo, you saved my day, thanks :)

[DrAuYueng]

You can try xcode-select --install

worked for me

[cnjsstong]

open /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg

This does the magic.

[kongque]

xcode-select --install

worked for me

[kamal-github]

I was seeing the same issue but that was due to GCC, which I install using apk add build-base

[micklove]

FYI - Had the same issue, tried everything above

However, the file, mentioned in comments above...

/Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg

seems to be no longer available, with the latest version of xcode, see the New Features section here
https://developer.apple.com/documentation/xcode_release_notes/xcode_10_release_notes

---

Solution:

Running brew doctor, as per the instructions below...

Warning: Unbrewed header files were found in /usr/local/include.
If you didn't put them there on purpose they could cause problems when
building Homebrew formulae, and may need to be deleted.

Unexpected header files:
  /usr/local/include/abstract.h
  /usr/local/include/aes.h
  /usr/local/include/anchor.h
etc...

So, using the script provided in the link below, which simply moves the files one at a time to another folder, fixed the issue for me
https://github.com/SOHU-Co/kafka-node/issues/881#issuecomment-396197724

Repeated below...

mkdir /tmp/includes
brew doctor 2>&1 | grep "/usr/local/include" | awk '{$1=$1;print}' | xargs -I _ mv _ /tmp/includes

[wujunze]

open /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg

Nice

[cuiwm]

on mojave 10.14.4, it works. command line> open /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg

[xbeta]

open /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg

This fix it for me!

[raxod502]

Unfortunately, that package appears to no longer exist as of a recent update. What can I do?

% ls -lA /usr/include
ls: /usr/include: No such file or directory
% ls -lA /Library/Developer/CommandLineTools
total 0
drwxr-xr-x  6 root  admin  192 Jun  4 09:08 Library
drwxr-xr-x  6 root  wheel  192 Jun  4 09:08 SDKs
drwxr-xr-x  7 root  admin  224 Apr  5 17:30 usr
% ls -lA /Library/Developer/CommandLineTools/Packages
ls: /Library/Developer/CommandLineTools/Packages: No such file or directory
% xcode-select --install
xcode-select: error: command line tools are already installed, use "Software Update" to install updates

@ianlancetaylor I totally am on your side here, but unfortunately Apple has made it clear they want every project to update their build tooling to work with the weird new SDK system:

some software may fail to build correctly against the SDK and require macOS headers to be installed in the base system under /usr/include. If you are the maintainer of such software, we encourage you to update your project to work with the SDK or file a bug report for issues that are preventing you from doing so.

So unfortunately I think this is a bug in Go, unless you want to drop support for macOS.

[raxod502]

Solution: go to https://developer.apple.com/download/more/ (Apple Developer account required) and download "Command Line Tools (macOS 10.14) for Xcode 10.2.1" (or equivalent for your OS version). Extract that package, which installs the macOS_SDK_headers_for_macOS_10.14.pkg package to /Library/Developer/CommandLineTools/Packages, which you can then extract separately. That finally gets you your /usr/include back.

[ianlancetaylor]

@raxod502 Go doesn't care where the header file is. It only cares that it can pass

#include <stdlib.h>

to the C compiler and have the C compiler work. If that doesn't work, there is nothing we can do in Go to fix that.

[raxod502]

@ianlancetaylor I understand what you are saying, but I think Apple's implication is that the Go build system needs to pass an extra -I argument to the C compiler with the path to the macOS SDK. Yes, that's completely ridiculous -- but what is the alternative? Every single user of Go on macOS needs to export C_INCLUDE_PATH, or ...?

It is an unfortunate fact that the C compiler cannot find stdlib.h on macOS anymore, at least by default. So while it makes perfect sense to say "it is your own responsibility to make sure the compiler can find stdlib.h", the sad truth is that this means every single Go developer on macOS would be required to take manual steps to get Go working properly.

An alternative solution would be for Homebrew to do something to fix this problem in general, but I don't know what the options look like for that.

[ianlancetaylor]

Are you saying that every Makefile for a C program needs to add a -I option to find the standard header files on macOS?

[raxod502]

That is what I _thought_. However, I just did some more testing and it appears that I was wrong.

• The /usr/bin/gcc that ships with macOS can find the standard headers.
• The /usr/bin/clang that ships with macOS can find the standard headers.
• The /usr/local/bin/gcc-9 that is installed by Homebrew can find the standard headers.
• The /usr/local/opt/llvm/bin/clang that is installed by Homebrew cannot find the standard headers.

(It did not occur to me that the behavior might be different between different compilers.)

So what I conclude is that cgo defaults to using clang as the compiler, and since I have installed clang from Homebrew and added it to my PATH, this causes the error. Therefore, the problem lies with either Homebrew or LLVM -- not Go -- and somebody should open an issue against one of those projects.

I'm sorry for spreading misinformation here. Thanks for your help.

[ianlancetaylor]

Thanks for following up.

[polyrabbit]

So what I conclude is that cgo defaults to using clang as the compiler, and since I have installed clang from Homebrew and added it to my PATH, this causes the error. Therefore, the problem lies with either Homebrew or LLVM -- not Go -- and somebody should open an issue against one of those projects.

@raxod502 Thanks for the advice. In this case, just unlinking LLVM temporally fixes this issue:

brew unlink llvm@4

[leexingliang]

open /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg

it works.

[grahammiln]

System headers have moved

Apple have changed the default location of the system headers with macOS 10.14, Mojave, and Xcode 10:

Xcode 10 Release Notes

...

The Command Line Tools package installs the macOS system headers inside the macOS SDK. Software that compiles with the installed tools will search for headers within the macOS SDK provided by either Xcode at:

/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk

or the Command Line Tools at:

/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk

depending on which is selected using xcode-select.
The command line tools will search the SDK for system headers by default. However, some software may fail to build correctly against the SDK and require macOS headers to be installed in the base system under /usr/include. If you are the maintainer of such software, we encourage you to update your project to work with the SDK or file a bug report for issues that are preventing you from doing so. As a workaround, an extra package is provided which will install the headers to the base system. In a future release, this package will no longer be provided. You can find this package at:

/Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg


To make sure that you're using the intended version of the command line tools, run xcode-select -s <path to Xcode> or xcode select -s /Library/Developer/CommandLineTools after installing.

[Soypete]

this is the path to the stlib.h file
/Library/Developer/CommandLineTools/SDKs/MacOSX10.15.sdk/usr/include/stlib.h

[shalakhin]

Shortly the way it worked on macOS Catalina in my case:

export CPATH="/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/"
export CGO_ENABLED=1; export CC=gcc;

[weihesdlegend]

Shortly the way it worked on macOS Catalina in my case:

export CPATH="/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/"
export CGO_ENABLED=1; export CC=gcc;

doesn't work in my case

[mutescent]

Shortly the way it worked on macOS Catalina in my case:

export CPATH="/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/"
export CGO_ENABLED=1; export CC=gcc;

This works for me, using Catalina.

[fredcarle]

Shortly the way it worked on macOS Catalina in my case:

export CPATH="/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/"
export CGO_ENABLED=1; export CC=gcc;

Thanks @shalakhin! This works for me in Catalina

[damienstanton]

Shortly the way it worked on macOS Catalina in my case:

export CPATH="/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/"
export CGO_ENABLED=1; export CC=gcc;

This does not work for me, using Go 1.12.14.

[urjitbhatia]

Removing brew llvm helped me. brew remove llvm I think it was not searching for the headers in the right spot.

[ogreface]

@urjitbhatia Thanks! Same issue here on Catalina. xcode-select --install && brew remove llvm got me going.

[newbieh4cker]

if someone facing this issue in catalina (10.15)
try this.
export SDKROOT="$(xcrun --sdk macosx --show-sdk-path)"

[gezibash]

xcode-select --install gave me
xcode-select: error: command line tools are already installed, use "Software Update" to install updates.

brew remove llvm worked and solved the issue

[chetanyakan]

Maybe this can help someone: https://github.com/mattn/go-sqlite3/issues/481#issuecomment-355717133

[hakkiyagiz]

Removing brew llvm helped me. brew remove llvm I think it was not searching for the headers in the right spot.

worked like a charm! thanks

[starlightme]

if someone facing this issue in catalina (10.15)
try this.
export SDKROOT="$(xcrun --sdk macosx --show-sdk-path)"

Thanks a lot! This work for me!

[blackbeans]

it works for me (Catalina 15.6)

brew remove llvm

[malajisi]

It's all related to c compiler clang... I found the clue from the discussion above and solved my issue( I install older version clang6 pkg and leave a export in .bash_profile), all these caused by clang. So
FIRST check the environment in terminal with
clang -v
If it's too old. Change to use the newest Xcode installed clang, for macOS Mojave maybe 10. All will done.

[tempcke]

So I had the same/very similar issue running linux mint and this resolved the issue for me

sudo apt update
sudo apt-get install build-essential

I'm posting this here because this is the number one search result on google, so others searching will land here ..