Issues with linking between CocoaPods swift based libraries and Obj-C based project can happens because project configuration does not contains information about location of swift lib. Just help Xcode to find it.
Put "$(TOOLCHAIN DIR)/usr/lib/swift/$(PLATFORM_NAME)" into the Linking Search Paths Build Settings.