Richard Purdie [Sat, 18 Nov 2006 15:47:42 +0000 (15:47 +0000)]
runqueue.py: Change failed tasks handling so all failed tasks are reported, not just the first. Also add signal handling so Ctrl+C only interrupts the main tasks upon the first keypress, the second keypress sends SIGTERM to all children
Holger Hans Peter Freyther [Fri, 17 Nov 2006 22:10:41 +0000 (22:10 +0000)]
Remember that we have compiled and added this file.
This reduces the time of the new parser from 2:42 to
1:6. The old one takes 1:42 on this macbook here
Holger Hans Peter Freyther [Fri, 17 Nov 2006 14:53:46 +0000 (14:53 +0000)]
Micro-Optimisation for parsing. Do not join and split the inherit_cache over and over again
Richard Purdie [Thu, 16 Nov 2006 20:15:42 +0000 (20:15 +0000)]
runqueue.py: Enhance dependency chain debug messages
Richard Purdie [Wed, 15 Nov 2006 23:20:29 +0000 (23:20 +0000)]
bin/bitbake: Improve -b error message
Richard Purdie [Tue, 14 Nov 2006 21:13:56 +0000 (21:13 +0000)]
tastdata.py: Minor speedup
Richard Purdie [Tue, 14 Nov 2006 21:12:05 +0000 (21:12 +0000)]
cache.py: Share the parser's mtime_cache, reducing the number of stat syscalls
Richard Purdie [Tue, 14 Nov 2006 15:09:11 +0000 (15:09 +0000)]
git.py: Fix conversion error
Richard Purdie [Tue, 14 Nov 2006 10:23:27 +0000 (10:23 +0000)]
taskqueue/runqueue.py: Remove matches_in_list and both_contain functions and use tasks_lookup instead - 33% speedup for world runqueue calculation
Richard Purdie [Tue, 14 Nov 2006 09:40:33 +0000 (09:40 +0000)]
runqueue.py: Catch EventException and don't print a backtrace
Richard Purdie [Tue, 14 Nov 2006 02:29:44 +0000 (02:29 +0000)]
taskdata.py: Stop failed dependencies being added back into taskData. Improve multiple provders messages
Richard Purdie [Mon, 13 Nov 2006 22:47:00 +0000 (22:47 +0000)]
Add perforce fetcher from Jordan Crouse, suitably modified for recent bitbake changes
Richard Purdie [Mon, 13 Nov 2006 15:30:21 +0000 (15:30 +0000)]
runqueue.py: Fix inverted logic. Less speed, more haste.
Richard Purdie [Mon, 13 Nov 2006 15:26:40 +0000 (15:26 +0000)]
runqueue.py: Fix indentation
Richard Purdie [Mon, 13 Nov 2006 15:20:30 +0000 (15:20 +0000)]
runqueue.py: Improve handling of zero length task lists in -k case
Richard Purdie [Mon, 13 Nov 2006 00:19:15 +0000 (00:19 +0000)]
Bump to version 1.7.4
Richard Purdie [Mon, 13 Nov 2006 00:18:18 +0000 (00:18 +0000)]
providers.py: Make PREFERRED_PROVIDER_foobar defaults to foobar if available
Richard Purdie [Sun, 12 Nov 2006 23:59:27 +0000 (23:59 +0000)]
runqueue.py: Avoid errors in builds with build failures when using -k option
Richard Purdie [Sun, 12 Nov 2006 23:58:26 +0000 (23:58 +0000)]
runqueue.py: Have recrdeptask follow depends as well as rdepends (and rdepends of depends and depends of rdepends)
Richard Purdie [Sun, 12 Nov 2006 23:56:39 +0000 (23:56 +0000)]
taskdata.py: Add some extra debug to dump_data and optimise depid and rdepid to avoid duplicates
Richard Purdie [Sun, 12 Nov 2006 21:57:23 +0000 (21:57 +0000)]
taskdata.py: Add missing error message for unbuildable targets
Richard Purdie [Sun, 12 Nov 2006 19:35:57 +0000 (19:35 +0000)]
runqueue.py: Add sanity check for zero length task list
Richard Purdie [Sun, 12 Nov 2006 19:34:40 +0000 (19:34 +0000)]
runqueue.py: raise build failure exceptions instead of trapping them to allow stack traces to be seen
Richard Purdie [Sun, 12 Nov 2006 19:20:50 +0000 (19:20 +0000)]
bitbake: Add calls to expandKeys, fixing issues in bug #1294
Richard Purdie [Sun, 12 Nov 2006 19:18:18 +0000 (19:18 +0000)]
taskdata.py: Improve abort flag handling, fixing several bugs
Richard Purdie [Sun, 12 Nov 2006 18:25:48 +0000 (18:25 +0000)]
svk.py: Remove unused variables
Richard Purdie [Sun, 12 Nov 2006 18:12:17 +0000 (18:12 +0000)]
Fetchers: More cleanups, error handling fixes, fix SRCDATE handling to account for PN 'overrides'
Richard Purdie [Sun, 12 Nov 2006 17:21:07 +0000 (17:21 +0000)]
Fetchers: Add forcefetch method for handling of SRCDATE now or tag= Move md5 code from wget.py into the fetchre core. Start generating md5 stamps for all downloads including scm tarballs. When a download is accessed, touch the md5 file to allow easy creation of source mirrors
Richard Purdie [Sun, 12 Nov 2006 15:30:35 +0000 (15:30 +0000)]
fetchers: Only call createCopy and update_data after checking if the download already exists. Refactor parameters to wget's fetch_uri and make md5 a global urldata option.
Richard Purdie [Sun, 12 Nov 2006 15:15:31 +0000 (15:15 +0000)]
svn.py: Fix a references to date
Richard Purdie [Sun, 12 Nov 2006 15:10:51 +0000 (15:10 +0000)]
svn.py: Fix a reference to parm
Richard Purdie [Sun, 12 Nov 2006 15:03:40 +0000 (15:03 +0000)]
fetchers: Cleanup more variables
Richard Purdie [Sun, 12 Nov 2006 14:31:10 +0000 (14:31 +0000)]
fetchers: Remove check_for_tarball() in favour of try_mirror directly
Richard Purdie [Sun, 12 Nov 2006 14:25:28 +0000 (14:25 +0000)]
fetchers: Create a urldata object which is passed between the different url methods. Start to use this to remove duplicate code and duplicate function execution, simplifying the fetchers
Richard Purdie [Sun, 12 Nov 2006 00:12:32 +0000 (00:12 +0000)]
fetchers: Refactor interating through urls into the fetcher core (preparing for common md5/tarball stash code)
Richard Purdie [Sat, 11 Nov 2006 19:10:44 +0000 (19:10 +0000)]
Add ssh fetcher written by kergoth (from poky)
Richard Purdie [Fri, 10 Nov 2006 13:53:10 +0000 (13:53 +0000)]
data.py: Fix emit_env() to expand keynames as well as values
Richard Purdie [Thu, 9 Nov 2006 23:12:09 +0000 (23:12 +0000)]
Improve errors messages for required vs. inherited files
Holger Hans Peter Freyther [Thu, 9 Nov 2006 22:44:01 +0000 (22:44 +0000)]
lib/bb/parse/parse_py/BBHandler.py: Commit the parsed method at EOF
Make sure to commit the pending __body__ when we are
__inpython__. Currently sending '' lead to simply appending
it to the body.
We create a special LINE Number to indicate the EOF which
will lead to closing/comitting the code.
The side effects of this can be huge... I mean huge
Richard Purdie [Sun, 5 Nov 2006 11:14:56 +0000 (11:14 +0000)]
BBHandler.py: make inherit fail if the class doesn't exist (#1478)
Richard Purdie [Sat, 4 Nov 2006 19:06:40 +0000 (19:06 +0000)]
shell.py: Add support for the abort flag
Holger Hans Peter Freyther [Wed, 1 Nov 2006 11:18:27 +0000 (11:18 +0000)]
bitbake/trunk/bitbake: Add more files to the MANIFEST and make it work again
Holger Hans Peter Freyther [Wed, 1 Nov 2006 11:11:36 +0000 (11:11 +0000)]
BitBake: Tag 1.6.2 and 1.7.2 of BitBake
Richard Purdie [Sun, 29 Oct 2006 13:35:17 +0000 (13:35 +0000)]
cache.py: Allow version field in DEPENDS (ignored for now)
Richard Purdie [Sat, 21 Oct 2006 11:45:55 +0000 (11:45 +0000)]
bump 1.7 versions
Richard Purdie [Wed, 4 Oct 2006 08:12:55 +0000 (08:12 +0000)]
bin/bitbake: fix typo
Richard Purdie [Tue, 3 Oct 2006 22:45:05 +0000 (22:45 +0000)]
bin/bitbake: Move handle_data() into parse_bbfiles instead of the callback
Richard Purdie [Tue, 3 Oct 2006 22:39:12 +0000 (22:39 +0000)]
cache.py: Stop passing cooker around as its no longer needed
Richard Purdie [Tue, 3 Oct 2006 22:34:21 +0000 (22:34 +0000)]
parse_py/ConfHandler.py: Remove broken default options (as identified by mithro)
Richard Purdie [Tue, 3 Oct 2006 22:32:55 +0000 (22:32 +0000)]
data_smart.py: Add expand_cache, caching expanded data (but wiped on any write to the data) - gives a performance improvement
Chris Larson [Thu, 28 Sep 2006 18:36:47 +0000 (18:36 +0000)]
Minor bugfix in taskdata, the dump function was passing a list to bb.msg.debug where it expected a string. Use ', '.join() to create a string.
Richard Purdie [Sat, 16 Sep 2006 22:30:33 +0000 (22:30 +0000)]
taskdata.py: Remove a seemingly incorrect line of code fixing issues reported by pH5. This code was likely added for a reason so lets see what breaks...
Richard Purdie [Sat, 16 Sep 2006 14:27:25 +0000 (14:27 +0000)]
Fix -f force option when used without -b
Richard Purdie [Sat, 16 Sep 2006 14:26:35 +0000 (14:26 +0000)]
taskData.py: Only mark external targets as external
Richard Purdie [Fri, 15 Sep 2006 15:34:54 +0000 (15:34 +0000)]
cache.py: Don't error if a file doesn't exist, just mark the cache entry invalid
Richard Purdie [Thu, 14 Sep 2006 22:17:29 +0000 (22:17 +0000)]
taskqueue.py: Add a small cache for task ids for a big speed improvement
Richard Purdie [Thu, 14 Sep 2006 20:40:43 +0000 (20:40 +0000)]
runqueue.py: Convert Deps and RunDeps fields into sets, add debugging code for tracing indriect circular dependencies
Michael 'Mickey' Lauer [Mon, 11 Sep 2006 22:50:28 +0000 (22:50 +0000)]
* shell: fix 'which' command
* shell: use 'rebuild' task for implementing rebuild
Richard Purdie [Mon, 11 Sep 2006 11:46:32 +0000 (11:46 +0000)]
bin/bitbake: parse.handle must have an absolute path
Richard Purdie [Mon, 11 Sep 2006 11:34:00 +0000 (11:34 +0000)]
bitbake/lib/bb/shell.py:
bitbake/bin/bitbake:
Split collect_bbfiles into collect_bbfiles and parse_bbfiles
Allow -b option to accept an expression which uniquely identifies a .bb file instead of requiring a full path
Disable BBFILES support within .bb files (it was already non-functional)
Richard Purdie [Mon, 11 Sep 2006 11:28:08 +0000 (11:28 +0000)]
cache.py: The cache doesn't really need to know about any progress callback - adjust logging accordingly
Richard Purdie [Sun, 10 Sep 2006 22:02:58 +0000 (22:02 +0000)]
taskdata.py: Clean up mesage handling for unbuildable targets - log at debug level unless the target was directly requested
Richard Purdie [Sun, 10 Sep 2006 21:39:29 +0000 (21:39 +0000)]
build.py: Really fix debug_level references causing excessive debug output (s/general/default - thanks for spotting koen)
Richard Purdie [Sun, 10 Sep 2006 21:34:05 +0000 (21:34 +0000)]
build.py: Fix debug_level references causing excessive debug output
Richard Purdie [Sun, 10 Sep 2006 21:17:02 +0000 (21:17 +0000)]
cache.py: Drop uneeded BUILD_ALL_DEPS variable
Richard Purdie [Sun, 10 Sep 2006 21:16:02 +0000 (21:16 +0000)]
lib/bb/shell.py - Use taskData and runQueue directly
lib/bb/runqueue.py - Add fn to TaskFailure
bin/bitbake - Remove now uneeded buildProvider
Richard Purdie [Sun, 10 Sep 2006 21:12:04 +0000 (21:12 +0000)]
msg.py: Each -l option increases the debug level of that logging domain by 1 (similar to -D behaviour).
Richard Purdie [Sun, 10 Sep 2006 21:10:10 +0000 (21:10 +0000)]
runqueue.py: Upon failure in abort mode, raise an exception rather than sys.exit
Richard Purdie [Sat, 9 Sep 2006 23:29:36 +0000 (23:29 +0000)]
Turn BBParsingStatus into CacheData and move to cache.py
Richard Purdie [Sat, 9 Sep 2006 23:04:32 +0000 (23:04 +0000)]
providers.py: Improve findBestProvider debug messages to explain the infamous 'preferred version 2.4 of glibc not available' messgae
Richard Purdie [Sat, 9 Sep 2006 21:49:34 +0000 (21:49 +0000)]
build.py: Add interactive flag for tasks to optionally disable console redirection. Default to maintain backwards compatibility
Richard Purdie [Sat, 9 Sep 2006 21:43:06 +0000 (21:43 +0000)]
bbimage: Add call to init logging variable
Richard Purdie [Sat, 9 Sep 2006 21:24:20 +0000 (21:24 +0000)]
Add bitbake -l option to specify debug domains to show
Richard Purdie [Sat, 9 Sep 2006 17:47:52 +0000 (17:47 +0000)]
Complete conversion to use bb.msg
Richard Purdie [Sat, 9 Sep 2006 16:58:58 +0000 (16:58 +0000)]
Convert fetchers to use bb.msg
Richard Purdie [Sat, 9 Sep 2006 16:43:55 +0000 (16:43 +0000)]
runqueue.py: Improve error messages (and make get_error_idstring a more global function)
Holger Hans Peter Freyther [Fri, 8 Sep 2006 21:55:12 +0000 (21:55 +0000)]
bitbake/trunk/bitbake/bin/bbimage: prepend the path to BitBake instead of appending to fix #1108
We want the 'local' libraries to be loaded before the installed copy. E.g.
if you have a old version of BitBake installed but run a newer version
from a local directory you want to load the BitBake libraries from the local
directory
Holger Hans Peter Freyther [Fri, 8 Sep 2006 21:52:32 +0000 (21:52 +0000)]
bitbake/bin/bitbake: Richard deserves a real (C) on BitBake
Holger Hans Peter Freyther [Fri, 8 Sep 2006 21:40:30 +0000 (21:40 +0000)]
bitbake/trunk/bitbake: Update the ChangeLog to mention Richards great changes and Paul's svn fetcher change
Holger Hans Peter Freyther [Fri, 8 Sep 2006 21:39:53 +0000 (21:39 +0000)]
bitbake/trunk/bitbake: Do svn co's to a permanent directory (SVNDIR) to be more similiar to the CVS fetcher
Patch courtsey Paul Sokolovsky to address #1367 to have a
permanent directory for subversion to ease updating of huge
repositories.
Holger Hans Peter Freyther [Fri, 8 Sep 2006 21:34:51 +0000 (21:34 +0000)]
bitbake/trunk/bitbake: Mention BitBake 1.6 as the stable branch
Richard Purdie [Wed, 23 Aug 2006 12:16:24 +0000 (12:16 +0000)]
runqueue.py: Improve circular depends error message
Richard Purdie [Tue, 22 Aug 2006 14:14:08 +0000 (14:14 +0000)]
runqueue.py: Fix the case where BB_NUMBER_THREADS is unset
Richard Purdie [Tue, 22 Aug 2006 14:07:46 +0000 (14:07 +0000)]
runqueue.py: Make sure number_tasks is a number
Richard Purdie [Tue, 22 Aug 2006 11:09:55 +0000 (11:09 +0000)]
runqueue.py: Make sure depends is initialised
Richard Purdie [Mon, 21 Aug 2006 21:58:45 +0000 (21:58 +0000)]
taskdata.py: Fix so only warn about failed providers once.
Richard Purdie [Mon, 21 Aug 2006 16:31:17 +0000 (16:31 +0000)]
runqueue.py: Print summary of active tasks when aborting a build run
Richard Purdie [Mon, 21 Aug 2006 15:38:17 +0000 (15:38 +0000)]
taskdata.py: Add handling to remove/ignore files which fail after after the checks earlier in add_[r]provider
Richard Purdie [Sun, 20 Aug 2006 22:26:42 +0000 (22:26 +0000)]
runqueue.py: Fix and disable some debug
Richard Purdie [Sun, 20 Aug 2006 21:52:23 +0000 (21:52 +0000)]
bitbake/lib/bb/taskdata.py:
bitbake/lib/bb/__init__.py:
bitbake/lib/bb/shell.py:
bitbake/lib/bb/runqueue.py:
bitbake/lib/bb/msg.py:
bitbake/MANIFEST:
bitbake/bin/bitbake:
Major rewrite and modularisation of the dependecy code. The code in bin/bitbake
is replaced by the taskdata and runqueue modules. The code is designed to support
multiple threads (although the initial threading algothirm is simplistic). The
new code is aimed to be maintainable and debuggable (once msy.py is finished).
Richard Purdie [Sun, 20 Aug 2006 21:36:57 +0000 (21:36 +0000)]
bitbake/lib/bb/build.py:
- Add flag to disable exec_task dependency execution
Richard Purdie [Sun, 20 Aug 2006 21:34:35 +0000 (21:34 +0000)]
bitbake/lib/bb/providers.py:
- Add NoRProvider exception
Richard Purdie [Wed, 16 Aug 2006 09:47:34 +0000 (09:47 +0000)]
Remove a debug statement that crept in
Holger Hans Peter Freyther [Tue, 15 Aug 2006 15:28:48 +0000 (15:28 +0000)]
bitbake: Trunk is now at version 1.7.0
Holger Hans Peter Freyther [Tue, 15 Aug 2006 15:16:30 +0000 (15:16 +0000)]
bitbake: Assign release number 1.6.0 to the trunk and update the ChangeLog
Richard Purdie [Mon, 14 Aug 2006 00:25:51 +0000 (00:25 +0000)]
trunk/bitbake/bin/bitbake:
* Fix up getRuntimeProviders calls in previous commit
Richard Purdie [Mon, 14 Aug 2006 00:22:37 +0000 (00:22 +0000)]
trunk/bitbake/lib/bb/providers.py:
trunk/bitbake/bin/bitbake:
* Move getProvidersRun -> bb.providers.getRuntimeProviders
* Make filterProviders build_cache_fail parameter optional, pending
rethink/removal
* Add NoProvider exception
Richard Purdie [Mon, 14 Aug 2006 00:14:33 +0000 (00:14 +0000)]
trunk/bitbake/bin/bitbake:
* fix references to findBestProvider (closes #1288)
Richard Purdie [Sun, 13 Aug 2006 23:56:42 +0000 (23:56 +0000)]
trunk/bitbake/bin/bitbake:
* Add some variables to the data cache
* Move self.preferred into the same place as other similar cache data
trunk/bitbake/lib/bb/cache.py:
* Bump cache version number
Richard Purdie [Sun, 13 Aug 2006 23:46:54 +0000 (23:46 +0000)]
trunk/bitbake/lib/bb/build.py:
* Add version of stamp_is_current that works with cached data
* Tweak mkstamp to work over broken? NFS filesystems (simply opening
the file for write access wasn't enough to change the file's timestamp)
* Have add_task create _task_deps variable containing various task flags
for cache use