An easier way to update your world

fei

Without doubt, one of Gentoo's best features is its package management system, Portage. Portage makes it very easy to update your entire system with one simple command. Sadly, things don't always go as smooth as they should. Almost every Gentoo user has typed emerge -uD world and gone to bed with the hope of waking up in the morning to a completely up to date system. Unfortunately, it's more likely that you.ll wake up to a failed emerge on package 3 of 220. And so the troubleshoot and emerge --resume process begins.

Enter update-world to save the day. Update-world is a bash script that was recently created by count_zero and posted in the forums. The script controls the update process and forces portage to skip past failed builds and continue compiling packages until the update list is finished. Failed builds are added to a list for review once the update is finished.

Note: The script does depend on the 'equery' command, part of app-portage/gentoolkit.

Obviously before you can start using the script, you'll need to download it, put it somewhere in your path, and make it executable.

Code Listing 3.1: getting the script

# wget -O /usr/bin/update-world http://countzero.amidal.com/files/update-world
# chmod +x /usr/bin/update-world

Now we're ready to start using the script.

Code Listing 3.2: running update-world

# update-world --prepare

This begins the update process by creating a list of packages to be emerged, as produced by emerge -uD --newuse world. (Alternatively, you can use update-world --empty to create a list of all packages on the system, akin to emerge -e world). This command creates a list called 'emergelist' in ~/.update-world/. Now, you can use your favorite editor to modify this list how you like--remove packages, change versions, etc. When you have the emergelist how you like it, you're ready to move onto the next step:

Code Listing 3.3: running update-world (cont)

# update-world --install

This command actually starts the build process, just as if you had typed emerge -uD world. The difference is, if a package fails for some reason or another, that package is added to a list 'failedlist' in ~/.update-world/. Also, a link to the portage log file for that package (usually located in /var/log/portage) is created in ~/.update-world/[date]/log/. Once the process is done, you'll be presented with a list of failed packages to take care of all at once, saving much time. If you ever need to stop the process, just hit 'Control-C' to abort the process. The update can then be restarted at any time, just where it left off, by retyping update-world --install.

shooter

I can't download the file,maybe the url has been crashed.

夕角

Good!!

Why not paste the script

zhllg

我还是用gwn里提示的那个朴素的方案
sh -c "sudo emerge -tauvDN world || until sudo emerge --resume --skipfirst; do sudo emerge --resume --skipfirst; done"

shooter

Post by 夕角
Good!!

Why not paste the script

Would you please to paste it here?

KenShinXF

代码在这里
http://www.gentoo.org/news/en/gwn/20061204-newsletter.xml

1. 
   
2. #!/bin/bash
   
3. # update-world 1.5
   
4. # count_zero 2006
   
5. # Licensed under the GPLv2
   
6. #
   
7. # update-world is a bash script that forces an emerge -uD world to continue, even
   
8. # in the face of (inevitable) compile failures.  Failed builds are added to a list,
   
9. # and the script jumps to the next package in the queue.
   
10. #
    
11. # just run update-world --prepare (or --empty) followed by update-world --install.
    
12. #
    
13. # Release Notes:
    
14. # v1.5: now handles 'fetch restriction' properly
    
15. # v1.4: uses '--newuse' for emerges to respect new use flags
    
16. # v1.3: uses '--oneshot' for emerges so they don't get added to the world file.
    
17. # v1.2: Script now detects log directly instead of accepting only /var/log/portage
    
18. # v1.1: minor bugfix to allow package without version to be added to 'emergelist'
    
19. # v1.0: Release
    
20. #
    
21. #
    
22. # Set the program directory and important variables
    
23. homedir=~/.update-world
    
24. workdir="$homedir/`date +%F`"
    
25. logdir="$workdir/log"
    
26. mkdir -p $logdir
    
27. touch $homedir/failedlist
    
28. emergelist=$homedir/emergelist
    
29. emergetemp=$workdir/emergetemp
    
30. failedlist=$homedir/failedlist
    
31. portlogdir=`cat /etc/make.conf | grep PORT_LOGDIR | sed 's/PORT_LOGDIR=//' | sed 's/"//g' | sed 's/\/$//'`
    
32. masked=$homedir/masked
    
33. # parameter for '--empty' to emerge -e world
    
34. if [[ $1 == '--empty' || $1 == '-e' ]]
    
35.    then parameter='-pev'
    
36.    else parameter='-puvD --newuse'
    
37. fi
    
38. #### update-world --prepare ####
    
39. # Prepare the list of packages to emerge into emerglist
    
40. if [[ $1 == "--prepare" || $1 == "-p" || $1 == '--empty' || $1 == '-e' ]]
    
41.    then
    
42.    if [[ -e $emergelist ]]
    
43.       then echo -n "The file 'emergelist' already exists and will be overwritten.
    
44. Continue anyway? (y/n) "
    
45.       read continue
    
46.       if [[ $continue == 'y' || $continue == 'yes' || $continue == 'Y' || $continue == 'Yes' || $continue == 'YES' || $continue == '' ]]
    
47.          then :
    
48.          else echo exiting.
    
49.          exit 0
    
50.       fi
    
51.       else :
    
52.    fi
    
53.    emerge $parameter world | tee $emergelist
    
54.    # Make sure there are no errors in the emerge process
    
55. echo
    
56.    if grep -q "blocks B " $emergelist
    
57.       then echo "WARNING: You have a blocking package.  Fix this before continuing."
    
58.       rm -f $emergelist
    
59.       exit 1
    
60.       elif grep -q "masked" $emergelist
    
61.       then echo "WARNING: You need to unmask some packages before continuing."
    
62.       rm -f $emergelist
    
63.       exit 1
    
64.       elif grep -q "emerge: there are no ebuilds to satisfy" $emergelist
    
65.       then echo "WARNING: One of the specified packages doesn't exist"
    
66.       rm -f $emergelist
    
67.       exit 1
    
68.       elif grep -q 'Fetch Restriction' $emergelist
    
69.       then fetchrestricted=`cat $emergelist | grep ^[[]ebuild[A-Za-z\ ]*F[A-Za-z\ ]*[]] | grep -o []][a-zA-Z0-9\/.\ -]*[[] | sed 's/\]\ //'  | sed 's/\ \[//'`
    
70.       echo "WARNING: The following packages have Fetch Restriction turned on:
    
71. $fetchrestricted
    
72. 
    
73. Please download the sources from the location specified in the ebuild to /usr/portage/distfiles/ and rerun this script."
    
74.       exit 1
    
75.       else :
    
76.    fi
    
77.    echo "
    
78. These are the packages that will be installed.  If you want to alter this list,
    
79. just edit the file 'emergelist' in $homedir. When finished, run
    
80. 'update-world --install'"
    
81.    cat $emergelist | sed '/^[TC]/d' | sed 's/\[ebuild.*[ A-Z]\]\ //' | sed '/^[ ]/d' | sed '/^[ ]*$/d' | sed '/Portage\ overlays/d' | sed 's/\ .*$//' | sort -d | sed 's/.*/\=&/' > $emergetemp
    
82.    mv $emergetemp $emergelist
    
83.    rm -f $failedlist
    
84.    exit 0
    
85. #### update-world --install ####
    
86. # Install the packages listed in emergelist
    
87. elif [[ $1 == "--install" || $1 == "-i" ]]
    
88.    then
    
89.    # Verify that the emergelist doesn't produce errors
    
90.    cat $emergelist | xargs emerge -p > $emergetemp
    
91.    if grep -q "blocks B " $emergetemp
    
92.       then echo "WARNING: You have a blocking package.  Fix this before continuing."
    
93.       rm -f $emergetemp
    
94.       exit 1
    
95.       elif grep -q "masked" $emergelist
    
96.       then echo "WARNING: You need to unmask some packages before continuing."
    
97.       rm -f $emergetemp
    
98.       exit 1
    
99.       elif grep -q "emerge: there are no ebuilds to satisfy" $emergelist
    
100.       then echo "WARNING: One of the specified packages doesn't exist"
     
101.       rm -f $emergetemp
     
102.       exit 1
     
103.       elif [[ -z `cat $emergelist` ]]
     
104.       then echo "WARNING: no 'emergelist' exists.  Did you run 'update-world --prepare' first?"
     
105.       rm -f $emergetemp
     
106.       exit 1
     
107.       else :
     
108.    fi
     
109.    # Until loop to make portage continue until finished
     
110.    increment=0
     
111.    until [[ $increment == 1 ]]
     
112.    do
     
113.       cat $emergelist | xargs emerge -1
     
114.       # Detect which packages have been successfully emerged and remove from the queue
     
115.       installed=`tac /var/log/emerge.log | sed '/Started\ emerge/,$d' | grep "completed emerge" | sed 's/^.*)\ //' | sed 's/\ to.*//'`
     
116.       for each in $installed
     
117.       do
     
118.          eachsed=`echo $each | sed 's|\/|\\\/|'`
     
119.          if [[ -z `cat $emergelist | grep $each` ]]
     
120.             then eachsed=`echo $eachsed | sed 's/\-[0-9].*//'`
     
121.             else :
     
122.          fi
     
123.          cat $emergelist | sed "/$eachsed/d" > $emergetemp
     
124.          mv $emergetemp $emergelist
     
125.       done
     
126.       # See if all packages have been emerged
     
127.       if [[ -z `cat $emergelist` ]]
     
128.          then increment=1
     
129.          else :
     
130.       fi
     
131.       if [[ $increment == 0 ]]
     
132.       then
     
133.       errorlog=`ls -t $portlogdir | sed '2,$d'`
     
134.       if [[ -n `cat $portlogdir/$errorlog | grep 'signal 2'` ]]
     
135.          then echo "
     
136. *** User hit 'Control-C' ... exiting.
     
137. "
     
138.          exit 1
     
139.          else :
     
140.       fi
     
141.       sleep 5
     
142.       echo
     
143.       echo "*** Hit Control-C to exit, or just wait to continue with emerge."
     
144.       echo
     
145.       sleep 10
     
146.       echo "*** Continuing with emerge."
     
147.       # Detect failed emerge and add to failedlist, remove failed package from emergelist
     
148.       failedpkg=`tac /var/log/emerge.log | sed '1d' | sed '/terminating/,$d' | sed '/completed\ emerge/,$d' | grep ">>>" | sed 's/.*)\ //' | sed 's/\ to.*//'`
     
149.       if [[ -n `tail -n 1 $failedlist | grep $failedpkg` ]]
     
150.          then echo "The failed package $failedpkg could not be merged and must be successfully installed before continuing."
     
151.          exit 1
     
152.          else :
     
153.       fi
     
154.       echo $failedpkg >> $failedlist
     
155.       failedpkgsed=`echo $failedpkg | sed 's|\/|\\\/|'`
     
156.       cat $emergelist | sed "/$failedpkgsed/d" > $emergetemp
     
157.       mv $emergetemp $emergelist
     
158.       ln -s $portlogdir/$errorlog $logdir/${errorlog}_error-log
     
159.       echo
     
160.       echo
     
161.       echo "*** $failedpkg compile failed, skipping."
     
162.       # Is there a package in 'emergelist' that requires the failed pkg as a dep? If so, remove it too.
     
163.       failedpkgdeps=`echo $failedpkg | sed 's/-[0-9].*//'`
     
164.       deps=`equery depends $failedpkgdeps | sed '/^\[/d' | sed 's/-[0-9].*//'`
     
165.       for each in `echo $deps`
     
166.       do
     
167.          if [[ -n `cat $emergelist | grep "$each"` ]]
     
168.             then
     
169.             if [[ -n `emerge -p $each | grep "$failedpkg"` ]]
     
170.                then
     
171.                each2=`cat $emergelist | grep $each | sed 's/\=//'`
     
172.                echo "$each2 (depends on $failedpkg)" >> $failedlist
     
173.                eachsed=`echo $each | sed 's|\/|\\\/|'`
     
174.                cat $emergelist | sed "/$eachsed/d" > $emergetemp
     
175.                mv $emergetemp $emergelist
     
176.                echo "*** $each depends on $failedpkg, skipping."
     
177.                else :
     
178.             fi
     
179.             else :
     
180.          fi
     
181.       done
     
182.       echo "*** Continuing with emerge world"
     
183.       else :
     
184.       fi
     
185.    done
     
186. # if improper argument is given to 'update-world' display the help text
     
187. else echo "update-world 1.0
     
188. count_zero 2006
     
189. licensed under the GPLv2
     
190. 
     
191. Description:
     
192. This is a bash script to automate the 'emerge -uD world' process.
     
193. Its purpose is to make updating the system as hands-free as possible.
     
194. It does this by automatically recovering from a failed emerge and moving
     
195. on to the next one, presenting the user with a list of failed packages
     
196. once the update has finished.  No more 'babysitting' the update process!
     
197. Just start it, and deal with any failed packages at the end.  Log files
     
198. from the failed emerges are saved in the log directory.
     
199. 
     
200. The default program directory is ~/.update-world
     
201. 
     
202. Usage:
     
203. update-world [--prepare | -p ]
     
204.    Prepares a list of packages produced by 'emerge -puvD world'
     
205.    and outputs them to the file 'emergelist' in the current directory.
     
206.    Add, remove, or change the version of any of the packages listed
     
207.    in this file with your favorite editor before continuing.
     
208. update-world [--empty | -e ]
     
209.    Same as --prepare except it performs 'emerge -ev world' to recompile
     
210.    all packages on a system.
     
211. update-world [--install | -i ]
     
212.    Begins the emerge process based upon the 'emergelist' file created
     
213.    from running 'update-world --prepare'.  Once finished, failed builds
     
214.    will be saved in the file 'failedlist' in the current directory."
     
215. exit 1
     
216. fi
     
217. 
     
218. 
     
219. echo "Congratulations!  'emerge world' complete."
     
220. echo
     
221. # All done! display the failed packages, if any
     
222. if [[ -z `cat $failedlist` ]]
     
223.    then echo "All packages emerged successfully"
     
224.    else echo "These packages couldn't be merged due to compile errors:"
     
225.    echo
     
226.    cat $failedlist
     
227.    echo
     
228.    echo "Look in $logdir/ for the portage log files of the failed builds.
     
229. Check bugs.gentoo.org or the Gentoo Forums for help."
     
230. fi
     
231. exit 0
     

复制代码

shooter

Post by KenShinXF
代码在这里
http://www.gentoo.org/news/en/gwn/20061204-newsletter.xml

3qx a lot

soloforce

我也是刚看到周报上的这个消息，果然sir上已经贴出。

终于可以象freebsd的port系统，敲个命令就去安心大睡了

hanhun

不错，不错！

hanhun

不错，不错！