I didn't use brew.
At first I was getting problems compiling with gcc here:
configure:2726: gcc -V >&5
clang: error: argument to '-V' is missing (expected 1 value)
clang: error: no input files
This went away after uninstalling xcode and developer tools then reinstalling osx developer tools december 2013 release.
I then had problems in that the compiled modules api version did not match the php version I was running as expected.
This turned out to be a problem with my environment in that I hadn't made sure that right php version was being used and pointed to in the right way at compile time.
After following Patrick Bougies blog I finally got to the environment I wanted(needed for my wants) that compiled phalcon nicely and delivered the expected phalcon module to use with the php version I felt I needed. More in that I now feel I have more control of my php dev environment.