Quantcast
Channel: MySQL Forums - Utilities
Viewing all 380 articles
Browse latest View live
↧

what is going on for PHP ? (6 replies)

July 10, 2016, 11:15 pm
$
0
0
hello,

I got a fabric server installed, from it's config it is listening on 127.0.0.1:32274

- how is this default setup even put in the doc ? nothing can access it that way

- all examples suing php try to acces fabric doing RPC XML over http but fabric does not evel listen to 80/8080 port

and all python/java examples directly acces port 32274


can someone enlight me on this?

thanks
↧
Search

COME ON !! please give me a real answer (1 reply)

July 10, 2016, 11:39 pm
$
0
0
Hello,

Mysql Fabric does XML/RPC on port 32274
PHP examples refer to XML/RPC over HTTP on port 8080

WHAT IS THE GLUE BETWEEN THESE TOO ?
↧
↧

MySQL Fabric HA (1 reply)

August 6, 2016, 7:17 pm
$
0
0
What happens if the master is "dead" but failover did not happen yet ?
In this case all current and new transactions are failed ?
↧

MySQL Fabric HA (1 reply)

August 6, 2016, 7:19 pm
$
0
0
What happens if all slaves are down? Can we take reads from the master?
If yes, is this something that needs to be configure manually ?
↧

mysqlslap (1 reply)

August 14, 2016, 5:45 pm
$
0
0
Hi,

We have two tables (A=38 million rows) & (B=20 millions of rows), when we run count query after join both table (join column indexed) and we provide one where clause ( also indexed ). The query examine 200 thousand rows and return count. Query took 200 milliseconds to execute.

My first question is that is this time is OK! or we need to reduce this time ?

Second question when I use same query with mysqlslap with 100 concurrent value it took four minute to complete, why it took so long? A simple count query is not blocking on Innodb engine.

The testing instance has 15 GB RAM and 2VCPU (AWS RDS).

Thank you
↧
↧

Not able to connect mysql fabric remotely (no replies)

August 23, 2016, 4:29 am
$
0
0
Hi, I have set up Mysql fabric. But not able to connect to it remotely. Below is my config.

[DEFAULT]
prefix =
sysconfdir = /etc
logdir = /var/log

[storage]
address = linux08:3306
user = fabric
password =
database = fabric
auth_plugin = mysql_native_password
connection_timeout = 6
connection_attempts = 6
connection_delay = 1

[servers]
user = fabric
password =
backup_user = fabric
backup_password =
restore_user = fabric
restore_password =
unreachable_timeout = 5

[protocol.xmlrpc]
address = 10.0.0.208:32274
threads = 5
user = admin
password =
disable_authentication = no
realm = MySQL Fabric
ssl_ca =
ssl_cert =
ssl_key =

[protocol.mysql]
address = linux08:32275
user = admin
password =
disable_authentication = no
ssl_ca =
ssl_cert =
ssl_key =

[executor]
executors = 5

[logging]
level = INFO
url = file:///var/log/fabric.log

[sharding]
mysqldump_program = /usr/bin/mysqldump
mysqlclient_program = /usr/bin/mysql
prune_limit = 10000

[statistics]
prune_time = 3600

[failure_tracking]
notifications = 300
notification_clients = 50
notification_interval = 60
failover_interval = 0
detections = 3
detection_interval = 6
detection_timeout = 1
prune_time = 3600

[connector]
ttl = 1
↧

Not able to connect mysql fabric remotely (no replies)

August 23, 2016, 4:42 am
$
0
0
I have installed Mysql Fabric, but not able to access it remotely. Please see my config below.

[DEFAULT]
prefix =
sysconfdir = /etc
logdir = /var/log

[storage]
address = linux08:3306
user = fabric
password =
database = fabric
auth_plugin = mysql_native_password
connection_timeout = 6
connection_attempts = 6
connection_delay = 1

[servers]
user = fabric
password =
backup_user = fabric
backup_password =
restore_user = fabric
restore_password =
unreachable_timeout = 5

[protocol.xmlrpc]
address = 10.0.0.208:32274
threads = 5
user = admin
password =
disable_authentication = no
realm = MySQL Fabric
ssl_ca =
ssl_cert =
ssl_key =

[protocol.mysql]
address = linux08:32275
user = admin
password =
disable_authentication = no
ssl_ca =
ssl_cert =
ssl_key =

[executor]
executors = 5

[logging]
level = INFO
url = file:///var/log/fabric.log

[sharding]
mysqldump_program = /usr/bin/mysqldump
mysqlclient_program = /usr/bin/mysql
prune_limit = 10000

[statistics]
prune_time = 3600

[failure_tracking]
notifications = 300
notification_clients = 50
notification_interval = 60
failover_interval = 0
detections = 3
detection_interval = 6
detection_timeout = 1
prune_time = 3600

[connector]
ttl = 1
↧

Mysql Fabric hash sharding not balanced in shards (no replies)

August 23, 2016, 10:02 am
$
0
0
MySQL Fabric 1.5.6
MySQL version: 5.6.31
O/S version: Centos 6.8

group_id description failure_detector master_uuid
-------- ----------- ---------------- ------------------------------------
global None 1 103383e3-542d-11e6-b7c0-066c5b481b6b
s1 None 1 605fe051-5389-11e6-b394-06fbcce39c6f
s3 None 1 b3689258-5389-11e6-b396-06a644a10425
s2 None 1 ff024a40-5386-11e6-b385-0661de27c503

mapping_id type_name table_name global_group column_name
---------- --------- -------------- ------------ -----------
1 HASH silo_db.Member global id


I'm using python mysql connector to load the data.

mysql-connector-python-2.1.3

When I load the data it don't balance over 3 shards. It's skewing one shard a lot.

Issue is when I query fabric to locate the record, it does say that it's on different shard but it's not loading on the shard. In other words, connector is not loading in the right shard as per fabric. When I ask fabric to locate the record it's not there on that shard. See below


mysqlfabric sharding lookup_servers silo_db.MemberMME 2000
Fabric UUID: 5ca1ab1e-a007-feed-f00d-cab3fe13249e
Time-To-Live: 1

server_uuid address status mode weight
------------------------------------ ----------- ------- ---------- ------
ff024a40-5386-11e6-b385-0661de27c503 s2-mme:3306 PRIMARY READ_WRITE 1.0

This record is not on that shard. It's on shard s1-mme. This is skewing data a lot and totally imbalanced over the shards.

Any help would be highly appreciate that why hash is not working or it's a connector issue while loading.

Best,
↧
Search

Mysql fabric is not found (2 replies)

August 24, 2016, 10:40 am
$
0
0
Hi,

i am new to mysql utilities. i am using Red Hat Enterprise Linux 7 and i have installed mysql-utilities-1.6.4-1.el7.noarch.rpm.

some how mysqlfabric command is not found, however i am able to find mysqlauditadmin, mysqldiff , mysqlfrm ..etc

any idea why mysqlfabric is not there?
↧
↧

Fabric creates multiple DB connections (5 replies)

September 1, 2016, 12:48 am
$
0
0
I have setup of 1 global group, 3 HA groups and 1 fabric node

The below piece of code ends up creating thousands of physical DB connections. The code errors out once all the max connection on DB is reached. According to my understanding, 1 fabric connection will contain map of single database connections to each physical DB servers.
Then why is below code trying to create thousands of physical connection on my HA1 server?

The range grouping is setup as 1-33000 to HA1, 33001-66000 to HA2 and 66001 onwards to HA3

Connection rawConnection = DriverManager.getConnection("jdbc:mysql:fabric://<fabricServer>:<port>/employees?fabricUsername=<fabricUser>&fabricPassword=<fabricPassword>&fabricShardTable=employees.employees", "<db_user>", "<db_password>");

FabricMySQLConnection fabricConnection = (FabricMySQLConnection) rawConnection;

for(int emp_id=1; emp_id<100000; emp_id++) {
fabricConnection.setShardKey(emp_id);
PreparedStatement ps = fabricConnection.prepareStatement(INSERT_EMPLOYEE_SQL);
ps.setInt(1, emp_id);
ps.setString(2, "Name"+i);
ps.setString(3, "Surname"+i);
ps.executeUpdate();
ps.close();
ps == null;
}


PS: i am using PreparedStatement inside the loop and not outside because i want to simulate real world scenareo where multipl user requests will run in parallel and they will create their own PreparedStatements
↧

Does Fabric work only with GTID based replication? (5 replies)

September 28, 2016, 12:56 am
$
0
0
I have to support my database with MyISAM storage engine. So I try to configure Fabric to use Binary Log File Position Based Replication. But I couldn't get it work. Does Fabric work only with GTID based replication?

Thanks
↧

2003: Can't connect to MySQL server on '127.0.0.1:3307' (111 Connection refused). (no replies)

September 28, 2016, 12:44 pm
$
0
0
Hi all,

I am following this tutorial https://dev.mysql.com/doc/mysql-utilities/1.5/en/fabric-create-user.html

every time i use this command: sudo mysqlfabric group add my_group 127.0.0.1:3307

I get the following error:
Fabric UUID: 5ca1ab1e-a007-feed-f00d-cab3fe13249e
Time-To-Live: 1

ServerError: Error accessing server (127.0.0.1:3307): 2003: Can't connect to MySQL server on '127.0.0.1:3307' (111 Connection refused).

[name@computer/]$ sudo netstat -plutn | grep -i sql
tcp 0 0 127.0.0.1:3306 0.0.0.0:* LISTEN 22990/mysqld


I have found few suggestions which talk about privileges or using --bind-address=127.0.0.1 in my.cnf , however they didn't solve the issue.

any idea why I am getting this error?
↧

Fabric project status (no replies)

October 2, 2016, 2:52 am
$
0
0
Hi there!

I'm new to mysql utilities and interested in fabric project status.

I've found that fabric available in utilities version 1.5.6 and as said in changelog has been moved to separate project in 1.6.2, also found a fabric repo on github, last activity about a year ago.

So I have several questions about fabric:

1. Is it alive?
2. Where could I find more info about project progress and roadmap?
3. If the project will not progress what mysql tool could be considered as an alternative?
↧
↧

Install warning message regarding attribute verification (1 reply)

October 6, 2016, 2:39 pm
$
0
0
I am installing mysql utilities 1.6.4 package on sparc solaris. I get lots of these but the package seems to install. I am only looking for the mysqldbcopy but how do I get rid of these? There is no doc that says I have to add the user or group? Do I specify a user and group at the command line? Do I add the user 'common' and group 'pb2user'.

Thanks for any help.

pkgadd -d ./mysql-utilities-1.6.4-solaris10.pkg

nstalling MySQL Utilities 1.6.4 (GPL)
...

## Installing part 1 of 1.
/usr/bin/mysqlauditadmin
ERROR: attribute verification of </usr/bin/mysqlauditadmin> failed
group name <common> not found in group table(s)
owner name <pb2user> not found in passwd table(s)
/usr/bin/mysqlauditgrep
ERROR: attribute verification of </usr/bin/mysqlauditgrep> failed
group name <common> not found in group table(s)
owner name <pb2user> not found in passwd table(s)
/usr/bin/mysqlbinlogmove
ERROR: attribute verification of </usr/bin/mysqlbinlogmove> failed
group name <common> not found in group table(s)
owner name <pb2user> not found in passwd table(s)
/usr/bin/mysqlbinlogpurge
...
↧

Add shard to MySQL Fabric Cluster (1 reply)

November 28, 2016, 2:06 pm
$
0
0
Hi guys,

I have created a MySQL cluster base on this tutorial: https://dev.mysql.com/doc/mysql-utilities/1.5/en/fabric-quick-start-sharding-scenario.html.

But when I run command: mysqlfabric sharding add_shard 1 "group_id-1/1, group_id-2/100000, group_id-3/200000" --state=ENABLED , it happens below error:

DatabaseError: Error 'Operation CREATE USER failed for 'fabric_server'@'%'' on query. Default database: ''. Query: 'CREATE USER 'fabric_server'@'%' IDENTIFIED WITH 'mysql_native_password' AS '*14E65567ABDB5135D0CFD9A70B3032C179A49EE7''

DatabaseError: Command (SHOW SLAVE STATUS, ()) failed accessing (192.168.1.35:3306). MySQL Connection not available..

Would you help me check reason? Thank you so much!
↧
Search

Fabric LOG table not pruned (2 replies)

December 5, 2016, 7:02 pm
$
0
0
The LOG table in my mysql_fabric schema is growing by half a million rows per day. I have prune_time set to 3600 in both the [statistics] and [failure_tracking] sections of /etc/mysql/fabric.cfg.

Where should I be looking to figure out why old rows are not being deleted from the LOG table?
↧

Fabric - Lazy way to fix FAULTY node in DEV environment (no replies)

December 5, 2016, 3:39 pm
$
0
0
In a dev environment where the time to simply restore the full database to the slave is shorter than the expected time to investigate the cause, what are the recommended mysqlfabric commands?

The following works for me, but is there a better procedure?

1) Remove faulty server from group with "mysqlfabric group remove"
2) Restore faulty server with "mysqlfabric server clone"'
2a) Run "FLUSH PRIVILEGES" in slave. (I should probably log an enhancement to include --flush-privileges in the mysqldump executed by the clone command)
3) Re-add server to group with "mysqlfabric group add"
↧
↧

MySQL Fabric - Failover Testing (no replies)

December 9, 2016, 3:08 am
$
0
0
ENVIRONMENT
MySQL Enterprise 5.6.34
MySQL Utilities 1.5.6
MySQL Python Connector 2.1.0

I am testing high availability for MySQL and have created a 3 node replication group server1(master), server2 & server3(slaves). I have also installed MySQL Fabric on a separate server(fab1) and have successfully set up a Fabric group to monitor my 3 replication servers.

I have tested that failover works ok by shutting down server1 and seeing that server2 is promoted to be the primary and that replication continues to work ok. When I restart server1 and bring it back into the replication group as the master again it catches up on any updates and everything continues to work ok. So far I'm impressed and happy but this is all very basic stuff.

Next test was to switch master again by shutting down server1, again server2 is promoted to be the master server. I do some updates on server2 which are replicated to server3. I then restart server1 and promote it to be master and it catches up on updates made on server2 whilst it was down. Meanwhile, using the open client connection made when server2 was the primary, I make some further updates and drop a table. These do not get replicated to either server1 or server3 as the status of server2 within the Fabric group is now SECONDARY READ_ONLY. So now I have one server in my group that is out of sync with the others. When I try to do an update on server1(primary) to the table that was dropped on server2 I get a replication error and server2 required recovery.

As I'm fairly new to MySQL I'm guessing this is more to do with my lack of knowledge than a flaw in the design of MySQL & Fabric. Am I trying to do something it's not designed to do? Should I be checking all client connections are terminated prior to doing the 'failback' and making server1 the primary again?

Thanks in advance for you help. Regards Neil
↧

MySQL Fabric 1.6. (no replies)

April 20, 2016, 12:58 pm
$
0
0
I'm very keen to test the lastest BETA version of MySQL Fabric (multiple Fabric instances/nodes) as described in these posts:

https://blogs.oracle.com/mysqltesting/entry/mysql_fabric_multinode_setup_in
http://planet.mysql.com/entry/?id=5992723

These posts are saying that the lastest version of Fabric can be downloaded here: http://labs.mysql.com/. However on this page there is now way of downloading MySQL Fabric 1.6.2 (or newer).

In this post is mentioned that MySQL Fabric is no longer part of the MySQL Utilities release: http://mysqlhighavailability.com/mysql-utilities-release-1-6-2-beta/

The downloads section on dev.mysql.com (http://dev.mysql.com/downloads/fabric/) is still referring to MySQL Utilties (MySQL Fabric is no longer included in the recent releases of MySQL Utilties.

The github repo of MySQL Fabric only has commits until release 1.6.1 (which does not include the multi node functionality): https://github.com/mysql/mysql-fabric/tree/release-1.6.1

What's up? Is MySQL Fabric no longer maintained?
I've spent most of my day searching to try and find this release...
↧

Fabric,Create Sharding Map, Type OF LIST (1 reply)

June 1, 2016, 2:22 pm
$
0
0
When I create a LIST type sharding, it returns an error
shell>mysqlfabric sharding create_definition list group_global

Fabric UUID:
Time-To-Live: 1

ShardingError: Invalid Sharding Type LIST

how to create a LIST sharding
please help me out
↧
Viewing all 380 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>