[mongodb-dev] Failing To Build Mongo 3.6.4 on OSX

[David J]

When on new branch version 3.6.4 I failed to build.

--

git status

HEAD detached at r3.6.4

---

Command I use is as folllows:

scons --jobs 4 --dbg VERBOSE=on MONGO_VERSION=3.6.4.1


Here is the error I get:


scons: Building targets ...

Traceback (most recent call last):

File "buildscripts/idl/idlc.py", line 24, in <module>

import idl.compiler

File
"/Users/djanecek/devel/mongo/clean/mongo/buildscripts/idl/idl/compiler.py",
line 26, in <module>

from typing import Any, List

ImportError: No module named typing

scons: *** [build/debug/mongo/db/sessions_collection_config_server.o]
CalledProcessError : Command '['/usr/bin/python',
'buildscripts/idl/idlc.py', '--include', 'src',
'src/mongo/s/request_types/shard_collection.idl', '--write-dependencies']'
returned non-zero exit status 1

scons: building terminated because of errors.

build/debug/mongo/db/sessions_collection_config_server.o failed:
CalledProcessError : Command '['/usr/bin/python',
'buildscripts/idl/idlc.py', '--include', 'src',
'src/mongo/s/request_types/shard_collection.idl', '--write-dependencies']'
returned non-zero exit status 1



Note when I use the source code from version 3.4.14

----

git status

On branch r3.4.14

Your branch is up-to-date with 'origin/r3.4.14'.

---


and do following:

scons --jobs 4 --dbg MONGO_VERSION=3.4.14.1


mongo builds OK

['Andrew Morrow' via mongodb-dev]

Hi -

You need to run pip install -r buildscripts/requirements.txt to install the
required python packages.

Rename pip and add arguments as appropriate to your local system.

Thanks,
Andrew

Post by David J
When on new branch version 3.6.4 I failed to build.
--
git status
HEAD detached at r3.6.4
---
scons --jobs 4 --dbg VERBOSE=on MONGO_VERSION=3.6.4.1
scons: Building targets ...
File "buildscripts/idl/idlc.py", line 24, in <module>
import idl.compiler
File "/Users/djanecek/devel/mongo/clean/mongo/buildscripts/idl/idl/compiler.py",
line 26, in <module>
from typing import Any, List
ImportError: No module named typing
scons: *** [build/debug/mongo/db/sessions_collection_config_server.o]
CalledProcessError : Command '['/usr/bin/python',
'buildscripts/idl/idlc.py', '--include', 'src', 'src/mongo/s/request_types/shard_collection.idl',
'--write-dependencies']' returned non-zero exit status 1
scons: building terminated because of errors.
CalledProcessError : Command '['/usr/bin/python',
'buildscripts/idl/idlc.py', '--include', 'src', 'src/mongo/s/request_types/shard_collection.idl',
'--write-dependencies']' returned non-zero exit status 1
Note when I use the source code from version 3.4.14
----
git status
On branch r3.4.14
Your branch is up-to-date with 'origin/r3.4.14'.
---
scons --jobs 4 --dbg MONGO_VERSION=3.4.14.1
mongo builds OK
--
You received this message because you are subscribed to the Google Groups
"mongodb-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at https://groups.google.com/group/mongodb-dev.
To view this discussion on the web visit https://groups.google.com/d/
msgid/mongodb-dev/f92e4564-55ce-4fcd-a030-2c56476fa8c0%40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-dev/f92e4564-55ce-4fcd-a030-2c56476fa8c0%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.

[David J]

So as noted above by Andrew and my DevOps I needed to run the pip install
-r buildscripts/requirements.txt
( which was bit more complex, since needed to update the version of pip and
split the buildscripts/requirements.txt into two parts... )
and I got this compiling on OSX fine.

Now on Linux I am running into an intermitent internal error.( I have tried
the gcc 5.3.0, 5.4.0 and 5.5.0).
Error us below:

*internal compiler error: *in instantiate_decl, at cp/pt.c:20294
typename = std::enable_if_t<isFuture<RawResult>>,
* ^*
0x62097d instantiate_decl(tree_node*, int, bool)
../../gcc/cp/pt.c:20293
0x64fce2 mark_used(tree_node*, int)
../../gcc/cp/decl2.c:5113
0x61b7fd tsubst_copy_and_build(tree_node*, tree_node*, int, tree_node*,
bool, bool)
../../gcc/cp/pt.c:14755
0x621b22 tsubst_expr
../../gcc/cp/pt.c:14559
0x622aac tsubst_template_arg
../../gcc/cp/pt.c:9811
0x627159 tsubst_template_args
../../gcc/cp/pt.c:10377
0x61c457 tsubst(tree_node*, tree_node*, int, tree_node*)
../../gcc/cp/pt.c:12348
0x61c919 tsubst(tree_node*, tree_node*, int, tree_node*)
../../gcc/cp/pt.c:11986
0x62c8e4 type_unification_real
../../gcc/cp/pt.c:17157
0x62fc2d fn_type_unification(tree_node*, tree_node*, tree_node*, tree_node*
const*, unsigned int, tree_node*, unification_kind_t, int, bool, bool)
../../gcc/cp/pt.c:16491
0x5ecf49 add_template_candidate_real
../../gcc/cp/call.c:3067
0x5ed5cc add_template_candidate
../../gcc/cp/call.c:3164
0x5ed5cc add_candidates
../../gcc/cp/call.c:5295
0x5edb3b build_new_method_call_1
../../gcc/cp/call.c:8126
0x5edb3b build_new_method_call(tree_node*, tree_node*, vec<tree_node*,
va_gc, vl_embed>**, tree_node*, int, tree_node**, int)
../../gcc/cp/call.c:8322
0x66d87f cp_parser_postfix_expression
../../gcc/cp/parser.c:6347
0x66f819 cp_parser_unary_expression
../../gcc/cp/parser.c:7439
0x670397 cp_parser_binary_expression
../../gcc/cp/parser.c:8173
0x67098d cp_parser_assignment_expression
../../gcc/cp/parser.c:8431
0x672d01 cp_parser_expression
../../gcc/cp/parser.c:8585
Please submit a full bug report,
with preprocessed source if appropriate.
Please include the complete backtrace with any bug report.
See <http://gcc.gnu.org/bugs.html> for instructions.
scons: *** [build/opt/mongo/transport/transport_layer_asio.o] Error 1
scons: building terminated because of errors.
build/opt/mongo/transport/transport_layer_asio.o failed: Error 1

Now again this is not happening with the 3.4.14 build on the same machine.

I did read something in gcc bug database about this and mentions it was
fixed in 5.3.1 , but I do not see gcc 5.3.1 . In fact I would like to be
using the 5.4.x with the fix.

THanks
__DAVID

Post by David J
When on new branch version 3.6.4 I failed to build.
--
git status
HEAD detached at r3.6.4
---
scons --jobs 4 --dbg VERBOSE=on MONGO_VERSION=3.6.4.1
scons: Building targets ...
File "buildscripts/idl/idlc.py", line 24, in <module>
import idl.compiler
File
"/Users/djanecek/devel/mongo/clean/mongo/buildscripts/idl/idl/compiler.py",
line 26, in <module>
from typing import Any, List
ImportError: No module named typing
scons: *** [build/debug/mongo/db/sessions_collection_config_server.o]
CalledProcessError : Command '['/usr/bin/python',
'buildscripts/idl/idlc.py', '--include', 'src',
'src/mongo/s/request_types/shard_collection.idl', '--write-dependencies']'
returned non-zero exit status 1
scons: building terminated because of errors.
CalledProcessError : Command '['/usr/bin/python',
'buildscripts/idl/idlc.py', '--include', 'src',
'src/mongo/s/request_types/shard_collection.idl', '--write-dependencies']'
returned non-zero exit status 1
Note when I use the source code from version 3.4.14
----
git status
On branch r3.4.14
Your branch is up-to-date with 'origin/r3.4.14'.
---
scons --jobs 4 --dbg MONGO_VERSION=3.4.14.1
mongo builds OK

['Andrew Morrow' via mongodb-dev]

Hi -

Unfortunately, there isn't much we can do about toolchain bugs. We
currently build with GCC 5.4.0, so that is at least known to work for us.
Another option is to use clang or a newer GCC. If you use newer versions of
toolchains you may find that they emit new compiler warnings which our
build system escalates by default into errors - you can convert them back
to warnings by building with --disable-warnings-as-errors.

Thanks,
Andrew

Post by David J
So as noted above by Andrew and my DevOps I needed to run the pip install
-r buildscripts/requirements.txt
( which was bit more complex, since needed to update the version of pip
and split the buildscripts/requirements.txt into two parts... )
and I got this compiling on OSX fine.
Now on Linux I am running into an intermitent internal error.( I have
tried the gcc 5.3.0, 5.4.0 and 5.5.0).
*internal compiler error: *in instantiate_decl, at cp/pt.c:20294
typename = std::enable_if_t<isFuture<RawResult>>,
* ^*
0x62097d instantiate_decl(tree_node*, int, bool)
../../gcc/cp/pt.c:20293
0x64fce2 mark_used(tree_node*, int)
../../gcc/cp/decl2.c:5113
0x61b7fd tsubst_copy_and_build(tree_node*, tree_node*, int, tree_node*,
bool, bool)
../../gcc/cp/pt.c:14755
0x621b22 tsubst_expr
../../gcc/cp/pt.c:14559
0x622aac tsubst_template_arg
../../gcc/cp/pt.c:9811
0x627159 tsubst_template_args
../../gcc/cp/pt.c:10377
0x61c457 tsubst(tree_node*, tree_node*, int, tree_node*)
../../gcc/cp/pt.c:12348
0x61c919 tsubst(tree_node*, tree_node*, int, tree_node*)
../../gcc/cp/pt.c:11986
0x62c8e4 type_unification_real
../../gcc/cp/pt.c:17157
0x62fc2d fn_type_unification(tree_node*, tree_node*, tree_node*,
tree_node* const*, unsigned int, tree_node*, unification_kind_t, int, bool,
bool)
../../gcc/cp/pt.c:16491
0x5ecf49 add_template_candidate_real
../../gcc/cp/call.c:3067
0x5ed5cc add_template_candidate
../../gcc/cp/call.c:3164
0x5ed5cc add_candidates
../../gcc/cp/call.c:5295
0x5edb3b build_new_method_call_1
../../gcc/cp/call.c:8126
0x5edb3b build_new_method_call(tree_node*, tree_node*, vec<tree_node*,
va_gc, vl_embed>**, tree_node*, int, tree_node**, int)
../../gcc/cp/call.c:8322
0x66d87f cp_parser_postfix_expression
../../gcc/cp/parser.c:6347
0x66f819 cp_parser_unary_expression
../../gcc/cp/parser.c:7439
0x670397 cp_parser_binary_expression
../../gcc/cp/parser.c:8173
0x67098d cp_parser_assignment_expression
../../gcc/cp/parser.c:8431
0x672d01 cp_parser_expression
../../gcc/cp/parser.c:8585
Please submit a full bug report,
with preprocessed source if appropriate.
Please include the complete backtrace with any bug report.
See <http://gcc.gnu.org/bugs.html> for instructions.
scons: *** [build/opt/mongo/transport/transport_layer_asio.o] Error 1
scons: building terminated because of errors.
build/opt/mongo/transport/transport_layer_asio.o failed: Error 1
Now again this is not happening with the 3.4.14 build on the same machine.
I did read something in gcc bug database about this and mentions it was
fixed in 5.3.1 , but I do not see gcc 5.3.1 . In fact I would like to be
using the 5.4.x with the fix.
THanks
__DAVID

Post by David J
When on new branch version 3.6.4 I failed to build.
--
git status
HEAD detached at r3.6.4
---
scons --jobs 4 --dbg VERBOSE=on MONGO_VERSION=3.6.4.1
scons: Building targets ...
File "buildscripts/idl/idlc.py", line 24, in <module>
import idl.compiler
File "/Users/djanecek/devel/mongo/clean/mongo/buildscripts/idl/idl/compiler.py",
line 26, in <module>
from typing import Any, List
ImportError: No module named typing
scons: *** [build/debug/mongo/db/sessions_collection_config_server.o]
CalledProcessError : Command '['/usr/bin/python',
'buildscripts/idl/idlc.py', '--include', 'src',
'src/mongo/s/request_types/shard_collection.idl',
'--write-dependencies']' returned non-zero exit status 1
scons: building terminated because of errors.
CalledProcessError : Command '['/usr/bin/python',
'buildscripts/idl/idlc.py', '--include', 'src',
'src/mongo/s/request_types/shard_collection.idl',
'--write-dependencies']' returned non-zero exit status 1
Note when I use the source code from version 3.4.14
----
git status
On branch r3.4.14
Your branch is up-to-date with 'origin/r3.4.14'.
---
scons --jobs 4 --dbg MONGO_VERSION=3.4.14.1
mongo builds OK

--
You received this message because you are subscribed to the Google Groups
"mongodb-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at https://groups.google.com/group/mongodb-dev.
To view this discussion on the web visit https://groups.google.com/d/
msgid/mongodb-dev/fd1eff69-c3ec-4d16-9bf6-6d8c12b9b9a2%40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-dev/fd1eff69-c3ec-4d16-9bf6-6d8c12b9b9a2%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.