Bugzilla will undergo maintenance 2024-03-29 18h00 CET. Bugzilla will be placed in read-only mode at that time.

Some Eclipse Foundation services are deprecated, or will be soon. Please ensure you've read this important communication.
Bug 477175 - +Upgrade to Bugzilla 5.0.x
Summary: +Upgrade to Bugzilla 5.0.x
Status: RESOLVED FIXED
Alias: None
Product: Community
Classification: Eclipse Foundation
Component: Bugzilla (show other bugs)
Version: unspecified   Edit
Hardware: PC Linux
: P3 blocker (vote)
Target Milestone: ---   Edit
Assignee: Eclipse Webmaster CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on: 417702 477232
Blocks: bugzilla5VoteFeatureMissing 399391 446727 458561 469908 474146 480984 527882 528208 528745
  Show dependency tree
 
Reported: 2015-09-11 07:38 EDT by Denis Roy CLA
Modified: 2017-12-20 06:20 EST (History)
14 users (show)

See Also:


Attachments
Bash script to copy bug title to clipboard. (1.11 KB, text/plain)
2017-12-18 16:13 EST, Leo Ufimtsev CLA
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Denis Roy CLA 2015-09-11 07:38:39 EDT
Bugzilla 5.0 has been out for some time, and a 5.0.1 was released yesterday with the typical dot-oh fixes:

https://www.bugzilla.org/releases/5.0.1/release-notes.html
Comment 1 Denis Roy CLA 2015-09-11 07:44:03 EDT
- One big addition is a new REST-like endpoint 
- Memcached support
Comment 2 Sam Davis CLA 2015-09-11 13:21:30 EDT
The Mylyn connector has been tested against 5.0 but not yet 5.0.1. Frank, do you have any plans to add support for 5.0.1?
Comment 3 Frank Becker CLA 2015-09-11 14:14:59 EDT
(In reply to Denis Roy from comment #1)
> - One big addition is a new REST-like endpoint
We currently implement a  new Bugzilla Connector for the RST API (see https://wiki.eclipse.org/Mylyn/Bugzilla_5_Connector and)

> - Memcached support

(In reply to Sam Davis from comment #2)
> The Mylyn connector has been tested against 5.0 but not yet 5.0.1. Frank, do
> you have any plans to add support for 5.0.1?

Sorry I did not see this bug so I create bug#477232 for the update of the vagrant setup. After commit I update http://mylyn.org.
Comment 4 Denis Roy CLA 2015-09-11 14:42:51 EDT
FWIW we will be investigating and likely enabling the REST endpoints.  Perhaps that makes it easier for Mylyn.
Comment 5 Sam Davis CLA 2015-09-11 17:14:16 EDT
The new REST-based connector won't be ready for a while yet, but as long as the old XML-RPC APIs are still enabled the current connector should continue to work.
Comment 6 Sam Davis CLA 2015-09-11 17:14:50 EDT
...and those old APIs aren't slated to be removed from Bugzilla for a long time.
Comment 7 Frank Becker CLA 2015-09-12 08:48:55 EDT
(In reply to Sam Davis from comment #5)
> The new REST-based connector won't be ready for a while yet, but as long as
> the old XML-RPC APIs are still enabled the current connector should continue
> to work.
(In reply to Sam Davis from comment #6)
> ...and those old APIs aren't slated to be removed from Bugzilla for a long
> time.

The XML-RPC is only used for custom workflow. By default we use http requests with ctype=rdf (if possible) or grap http output. The update is done with http forms.
Comment 8 Sam Davis CLA 2015-09-14 13:08:53 EDT
Thanks Frank. My understanding is we're expecting that to continue working until at least Bugzilla 7, IIRC.
Comment 9 Frank Becker CLA 2015-09-14 14:17:14 EDT
(In reply to Sam Davis from comment #8)
> Thanks Frank. My understanding is we're expecting that to continue working
> until at least Bugzilla 7, IIRC.

Yes, but I think we should add new features / enhancements only to the REST connetor.
Comment 10 Sam Davis CLA 2015-09-14 17:38:16 EDT
Yes, agreed. I'm just saying that upgrading to Bugzilla 5 shouldn't break users of the existing connector.
Comment 11 Markus Keller CLA 2015-09-17 11:15:20 EDT
The test install would also be a good opportunity to finally fix a few pending issues with Bugzilla: Bug 446727, bug 399391, bug 474146.
Comment 12 Denis Roy CLA 2015-10-16 10:58:26 EDT
I usually put those as dependencies to this bug.  To each their own.
Comment 13 Denis Roy CLA 2015-12-17 13:19:52 EST
FWIW, we need to upgrade the host OS on the bugzilla cluster, as it's too old to run the version of Perl needed here. Target is 1Q2016.
Comment 14 Alexander Kurtakov CLA 2017-01-25 04:53:03 EST
Any progress on this one ?(In reply to comment #13)
> FWIW, we need to upgrade the host OS on the bugzilla cluster, as it's too old to
> run the version of Perl needed here. Target is 1Q2016.
Any progress on this one?
Comment 15 Eclipse Webmaster CLA 2017-07-05 14:08:58 EDT
We've put together a test server and we're working on a plan to try and do this sometime this summer.

-M.
Comment 16 Lars Vogel CLA 2017-07-05 14:11:40 EDT
(In reply to Eclipse Webmaster from comment #15)
> We've put together a test server and we're working on a plan to try and do
> this sometime this summer.
> 
> -M.

Good news. Thanks, really looking forward to the option to rework msispleled ;-) comments.
Comment 17 Denis Roy CLA 2017-10-31 09:22:52 EDT
Work has begun on this and a sandbox is up and running at:

https://bugs.eclipse.org/bugstest/

There is a lot of work to do since we're upgrading the underlying VMs too, and we must also ensure that Genie still works. But at least you can start tinkering with it. I'll start looking at the dependencies of this bug.
Comment 18 Leo Ufimtsev CLA 2017-10-31 15:01:12 EDT
(In reply to Denis Roy from comment #17)
> Work has begun on this and a sandbox is up and running at:
> 
> https://bugs.eclipse.org/bugstest/
> 
> There is a lot of work to do since we're upgrading the underlying VMs too,
> and we must also ensure that Genie still works. But at least you can start
> tinkering with it. I'll start looking at the dependencies of this bug.

I tested the sandbox, seems to work well so far. Comment tagging seems useful.
Comment 19 Denis Roy CLA 2017-10-31 15:34:21 EDT
The 5.0.3 release notes are here:
https://www.bugzilla.org/releases/5.0.3/release-notes.html

Specifically, new features in 5.x:
https://www.bugzilla.org/releases/5.0.3/release-notes.html#feat
Comment 20 Denis Roy CLA 2017-11-16 12:09:26 EST
The Bugzilla 5.0 REST API:
https://bugzilla.readthedocs.io/en/5.0/api/



In action on bugstest:

First 10 bugs of product Community:
https://bugs.eclipse.org/bugstest/rest/bug?product=Community&limit=10&offset=10

First 10 bugs of Community/Bugzilla:
https://bugs.eclipse.org/bugstest/rest/bug?product=Community&component=Bugzilla&limit=10

All products in Tools classification:
https://bugs.eclipse.org/bugstest/rest/product/Tools
Comment 21 Denis Roy CLA 2017-11-26 09:18:58 EST
Bugzilla 5.0.3 is running on bugs.eclipse.org

We'll let it bake for a bit and make sure all works as expected.
Comment 22 Holger Voormann CLA 2017-11-26 12:57:20 EST
It would be nice to have the bug icon of Eclipse (instead of the Bugzilla icon) as favicon like before.

Actual HTML:
<link rel="shortcut icon" href="images/favicon.ico">
=> https://bugs.eclipse.org/bugs/images/favicon.ico

Expected:
https://bugs.eclipse.org/favicon.ico
Comment 23 Denis Roy CLA 2017-11-26 13:28:07 EST
Good point, fixed. Thank you.
Comment 24 Alexander Kurtakov CLA 2017-11-26 13:29:23 EST
Gerrit and git links are no longer created in bugzillas. E.g. bug 527766 has the following gerrit https://git.eclipse.org/r/#/c/112298 but there is no notification in the bug.
Comment 25 Lakshmi P Shanmugam CLA 2017-11-27 05:06:44 EST
No comment added in bugzilla when gerrit patch was merged. https://git.eclipse.org/r/#/c/109980/ was merged but no comment was added to the bug.
Comment 26 Lars Vogel CLA 2017-11-27 10:51:49 EST
Trying to add a comment to Bug 527618 results in the following error:

 Bugzilla has suffered an internal error. Please save this page and send it to webmaster@eclipse.org with details of what you were doing at the time this message appeared.

URL: https://bugs.eclipse.org/bugs/process_bug.cgi?bug_file_loc=&blocked=&bug_status=RESOLVED&flag_type-4=X&id=527618&token=1511797769-2gI6W7JqrlIA_SqtF-ntqaDA8B2ljdMyH7LSc_yop1k&flag_type-17=X&flag_type-2=X&flag_type-12=X&dependson=&delta_ts=2017-11-22%2010%3A12%3A17&bug_severity=normal&defined_bug_ignored=1&flag_type-15=X&flag_type-11=X&keywords=&newalias=&target_milestone=4.8%20M4&rep_platform=All&op_sys=All&priority=P3&dup_id=&assigned_to=Lars.Vogel%40vogella.com&component=UI&comment=Merged%20Gerrit.&see_also=&flag_type-13=X&qa_contact=&short_desc=Retire%20org.eclipse.e4.demo.contacts%20demo%20from%20master&tag=&classification=Eclipse&flag_type-16=X&version=4.6&status_whiteboard=&resolution=FIXED&flag_type-8=X&flag_type-1=X&defined_groups=Security_Advisories&product=Platform&flag_type-14=X

Template->process() failed twice.
First error: file error - failed to create compiled templates directory: /localsite/data/template//localsite/template/en/default/email (mkdir /localsite/data/template//localsite/template/en/default/email: Read-only file system at /localsite/lib/x86_64-linux-thread-multi/Template/Provider.pm line 859. )
Second error: file error - cache failed to write code-error.html.tmpl: Error in tempfile() using template /localsite/data/template/localsite/template/en/default/global/XXXXXXXXXX: Could not create temp file /localsite/data/template/localsite/template/en/default/global/e745pu1p1c: Read-only file system at /localsite/lib/x86_64-linux-thread-multi/Template/Document.pm line 301.
Comment 27 Denis Roy CLA 2017-11-27 10:58:44 EST
(In reply to Lakshmi Shanmugam from comment #25)
> No comment added in bugzilla when gerrit patch was merged.
> https://git.eclipse.org/r/#/c/109980/ was merged but no comment was added to
> the bug.

Looking into it, thanks.



(In reply to Lars Vogel from comment #26)
> Trying to add a comment to Bug 527618 results in the following error:
> 
>  Bugzilla has suffered an internal error.

Broke it while installing XMLRPC. We're back in business.
Comment 28 Lars Vogel CLA 2017-11-27 13:01:23 EST
(In reply to Denis Roy from comment #27)

> Broke it while installing XMLRPC. We're back in business.

Just got this one while trying to update a bug query.

 Bugzilla has suffered an internal error. Please save this page and send it to webmaster@eclipse.org with details of what you were doing at the time this message appeared.

URL: https://bugs.eclipse.org/bugs/buglist.cgi?newquery=bug_status%3DUNCONFIRMED%26bug_status%3DNEW%26bug_status%3DASSIGNED%26bug_status%3DREOPENED%26classification%3DEclipse%26component%3DIDE%26component%3DRuntime%26component%3DSearch%26component%3DText%26component%3DUI%26component%3DUser%2520Assistance%26component%3DWebsite%26email1%3DLars.Vogel%2540vogella.com%26emailtype1%3Dsubstring%26known_name%3DEclipse%2520Current%2520Milestone%26list_id%3D17003117%26product%3DPDE%26product%3DPlatform%26query_format%3Dadvanced%26target_milestone%3D4.8%2520M4%26order%3Dchangeddate%252Cbug_status%252Cpriority%252Cassigned_to%252Cbug_id&cmdtype=doit&remtype=asnamed&token=1511805610-LS_13mUD_sn6yYo4iXDVYlt_altUCMJaZpo9ojq2pNA&newqueryname=Eclipse%20Current%20Milestone&list_id=17003118

Template->process() failed twice.
First error: file error - cache failed to write message.html.tmpl: Error in tempfile() using template /localsite/data/template/localsite/template/en/default/global/XXXXXXXXXX: Could not create temp file /localsite/data/template/localsite/template/en/default/global/j81SUldF6V: Read-only file system at /localsite/lib/x86_64-linux-thread-multi/Template/Document.pm line 301.
Second error: file error - cache failed to write code-error.html.tmpl: Error in tempfile() using template /localsite/data/template/localsite/template/en/default/global/XXXXXXXXXX: Could not create temp file /localsite/data/template/localsite/template/en/default/global/fJxmPTdMA5: Read-only file system at /localsite/lib/x86_64-linux-thread-multi/Template/Document.pm line 301.
Comment 29 Denis Roy CLA 2017-11-27 13:38:20 EST
The Bugzilla nodes are sometimes switching the data mount to "read-only" ... It's fixed for now but I'm looking into it.
Comment 30 Noopur Gupta CLA 2017-11-28 03:16:20 EST
Got this error while saving some changes in a bug:

An unexpected error occurred. This could be a temporary problem, or some code is behaving incorrectly. If this problem persists, please email this page to webmaster@eclipse.org with details of what you were doing at the time this message appeared.

URL: https://bugs.eclipse.org/bugs/process_bug.cgi?flag_type-15=X&dup_id=&id=527082&target_milestone=4.8%20M4&defined_groups=Security_Advisories&keywords=&tag=&flag_type-12=X&product=JDT&priority=P3&flag_type-13=X&newalias=&flag_type-4=X&flag_type-2=X&comment=Thanks%2C%20Lars.%0D%0A%0D%0A%28In%20reply%20to%20Eclipse%20Genie%20from%20comment%20%2313%29%0D%0A%3E%20New%20Gerrit%20change%20created%3A%20https%3A%2F%2Fgit.eclipse.org%2Fr%2F112343%0D%0AReleased%20with%3A%0D%0Ahttp%3A%2F%2Fgit.eclipse.org%2Fc%2Fjdt%2Feclipse.jdt.ui.git%2Fcommit%2F%3Fid%3D3fbfd3dcd67ff10b21d8a19ebbe92cc0cb5ea951%0D%0A%0D%0A%22pop-up%22%20can%20be%20added%20after%20bug%20527833%20is%20fixed.&flag_type-1=X&flag_type-8=X&delta_ts=2017-11-28%2002%3A09%3A36&qa_contact=&flag_type-17=X&blocked=&status_whiteboard=&resolution=FIXED&rep_platform=All&see_also=&classification=Eclipse&bug_file_loc=&version=4.7&token=1511856747-FtB-HtHFqgTe76VGK6aBUt0HmMdYEdBAtZcGJWIEHRc&component=UI&op_sys=All&short_desc=%5Bhovering%5D%5Bpreferences%5D%20Add%20%22Popup%22%20as%20search%20term%20to%20Hovers%20preference%20page&assigned_to=Lars.Vogel%40vogella.com&defined_bug_ignored=1&flag_type-11=X&bug_status=RESOLVED&dependson=&flag_type-16=X&flag_type-14=X&bug_severity=enhancement

undef error - This shouldn't happen at /usr/lib/perl5/5.18.2/Text/Wrap.pm line 84.
Comment 31 Noopur Gupta CLA 2017-11-28 03:22:33 EST
Also, I didn't get any e-mail notification after Eclipse Genie added a merge comment on bug i.e. Gerrit change https://git.eclipse.org/r/112344 was merged to [master].
Comment 32 Dani Megert CLA 2017-11-28 05:57:03 EST
(In reply to Noopur Gupta from comment #30)
> Got this error while saving some changes in a bug:

Just got the same error. The change was saved though.
Comment 33 Dani Megert CLA 2017-11-28 06:01:12 EST
(In reply to Dani Megert from comment #32)
> (In reply to Noopur Gupta from comment #30)
> > Got this error while saving some changes in a bug:
> 
> Just got the same error. The change was saved though.

Correction: the comment was added but the bug did not get reopened. Trying again gave the same error but the bug was reopened.
Comment 34 Dani Megert CLA 2017-11-28 08:27:05 EST
I get the error on almost every save.
Comment 35 Noopur Gupta CLA 2017-11-28 08:46:51 EST
I also didn't get any e-mail notifications today when comments were added by others to bug 527082.
Comment 36 Dani Megert CLA 2017-11-28 08:51:27 EST
(In reply to Noopur Gupta from comment #35)
> I also didn't get any e-mail notifications today when comments were added by
> others to bug 527082.

It was on that bug where I got the error. So, looks like no e-mail is sent when this happens.
Comment 37 Dani Megert CLA 2017-11-28 09:30:36 EST
Not sure whether related to the upgrade but since a few minutes I now get
500 Internal Server Error
on approximately every second request.
Comment 38 Dani Megert CLA 2017-11-29 03:50:46 EST
Raising severity. Still running into 

undef error - This shouldn't happen at /usr/lib/perl5/5.18.2/Text/Wrap.pm line 84.
Comment 39 Dani Megert CLA 2017-11-29 11:03:22 EST
This is a blocker: I can't add a flag to bug 526545. Fails with the error.
Comment 40 Denis Roy CLA 2017-11-29 12:09:22 EST
I'm looking into this. Odd that it's using the OS library instead of the local BZ One.

Dani, can you please try now?
Comment 41 Denis Roy CLA 2017-11-29 12:19:31 EST
Looks like system Wrap.pm is an older version that contains a fix.  I've installed a newer Wrap.pm in Bugzilla's local lib/ directory in the hopes that fixes it cleanly regardless of the system. Otherwise we'll patch the system bug.



diff -u /usr/lib/perl5/5.18.2/Text/Wrap.pm Wrap.pm 
--- /usr/lib/perl5/5.18.2/Text/Wrap.pm  2016-08-31 21:39:10.000000000 -0400
+++ Wrap.pm     2013-05-22 21:35:20.000000000 -0400
@@ -7,7 +7,7 @@
 @EXPORT = qw(wrap fill);
 @EXPORT_OK = qw($columns $break $huge);
 
-$VERSION = 2012.0818;
+$VERSION = 2013.0523;
 $SUBVERSION = 'modern';
 
 use 5.010_000;
@@ -64,7 +64,7 @@
                                ? unexpand($nl . $lead . $1)
                                : $nl . $lead . $1;
                        $remainder = $2;
-               } elsif ($huge eq 'wrap' && $t =~ /\G((?:(?!=[^\n])\X){$ll})/gc) {
+               } elsif ($huge eq 'wrap' && $t =~ /\G((?:(?=[^\n])\X){$ll})/gc) {
                        $r .= $unexpand 
                                ? unexpand($nl . $lead . $1)
                                : $nl . $lead . $1;
Comment 42 Frank Becker CLA 2017-11-29 15:44:00 EST
https://bugs.eclipse.org/bugs/show_bug.cgi?id=527895 show an SSLHandshakeException

Thoughts?
Comment 43 Dani Megert CLA 2017-11-30 08:34:39 EST
(In reply to Denis Roy from comment #40)
> I'm looking into this. Odd that it's using the OS library instead of the
> local BZ One.
> 
> Dani, can you please try now?

No issue so far and I could add reviewers again.
Comment 44 Denis Roy CLA 2017-11-30 10:55:03 EST
Closing as fixed. Bugzilla 5.0.3 seems to be stable on bugs.e.o
Comment 45 Dani Megert CLA 2017-11-30 11:44:29 EST
(In reply to Denis Roy from comment #44)
> Closing as fixed. Bugzilla 5.0.3 seems to be stable on bugs.e.o

Thanks for the upgrade!
Comment 46 Alexander Kurtakov CLA 2017-12-06 11:17:57 EST
I've opened bug 528208 for incomplete query results in order to not reopen this one.
Comment 47 Leo Ufimtsev CLA 2017-12-18 16:13:13 EST
Created attachment 271953 [details]
Bash script to copy bug title to clipboard.

For convenience:

I copy the bug title with link many many many times a day. Usually to paste them into a patch.
To automate this process, I wrote a bash script that copies the bug id/title with url to clipboard. Attaching here in case it's useful.

Features:
* Automatically strips out alias out of title. (unless 'a' paramater is specified)
* Adds 'Bug https://....id=507072' link, as per https://wiki.eclipse.org/Development_Resources/Contributing_via_Git#The_Commit_Record
* Developed for Firefox, but can probably be tailored to chrome without too much difficulty.
* Tested on Fedora 27 on Wayland.

For example, it would place something like this to your clipboard:
Bug 507072 – (LinuxIDEColorTracker) Implement fitting Linux colors for various IDE components
Bug: https://bugs.eclipse.org/bugs/show_bug.cgi?id=507072

The reason I post it here is actually because with Bugzilla 5, the 'Bug' is not appended to title anymore, this and Firefox 57's breakage of my old  "copy tab title & url" plugin drove me to write this script.

Hope it helps.
Comment 48 Leo Ufimtsev CLA 2017-12-18 16:16:09 EST
(In reply to Leo Ufimtsev from comment #47)
> For example, it would place something like this to your clipboard:
> Bug 507072 – (LinuxIDEColorTracker) Implement fitting Linux colors for
> various IDE components
> Bug: https://bugs.eclipse.org/bugs/show_bug.cgi?id=507072

Correction: it strips out the alias and dash:
Bug 507072 Implement fitting Linux colors for various IDE components
Bug: https://bugs.eclipse.org/bugs/show_bug.cgi?id=507072
Comment 49 Leo Ufimtsev CLA 2017-12-19 09:57:00 EST
Btw, I'd just like to point out that in Bugzilla 5 the voting feature went missing. Does it need to be re-enabled?
Bug 12115 – (bugzilla5VoteFeatureMissing) Please enable Bugzilla's voting feature
Bug: https://bugs.eclipse.org/bugs/show_bug.cgi?id=121155
Comment 50 Leo Ufimtsev CLA 2017-12-19 10:49:45 EST
(In reply to Leo Ufimtsev from comment #47)
> Created attachment 271953 [details]
> Bash script to copy bug title to clipboard.

I've had a few bug reports and feature requests for this script. Moving to it's own bug to avoid clutter:
Bug 528963 Bash script to copy bug title + url to clipboard for commit messages.
Comment 51 Lakshmi P Shanmugam CLA 2017-12-20 06:20:24 EST
Opened Bug 528745 to track 'Clone This Bug' not working.