Sep 10 13:22:22 devstack cinder-volume[74786]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74786) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 13:22:22 devstack cinder-volume[74786]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74786) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 13:22:22 devstack cinder-volume[74786]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74786) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 13:22:23 devstack cinder-volume[74786]: INFO dbcounter [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Registered counter for database cinder
Sep 10 13:22:24 devstack cinder-volume[74786]: DEBUG oslo_db.sqlalchemy.engines [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 13:22:24 devstack cinder-volume[74786]: DEBUG dbcounter [-] [74786] Writer thread running {{(pid=74786) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 13:22:24 devstack cinder-volume[74786]: INFO cinder.rpc [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 10 13:22:24 devstack cinder-volume[74786]: INFO cinder.rpc [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 10 13:22:24 devstack cinder-volume[74786]: DEBUG oslo_db.sqlalchemy.engines [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 13:22:24 devstack cinder-volume[74786]: INFO cinder.volume.manager [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Determined volume DB was empty at startup.
Sep 10 13:22:24 devstack cinder-volume[74786]: DEBUG cinder.volume.manager [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74786) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 10 13:22:24 devstack cinder-volume[74786]: INFO cinder.volume.manager [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 10 13:22:24 devstack cinder-volume[74786]: WARNING stevedore.named [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 10 13:22:24 devstack cinder-volume[74786]: WARNING castellan.key_manager [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 13:22:24 devstack cinder-volume[74786]: WARNING cinder.keymgr.conf_key_mgr [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 13:22:24 devstack cinder-volume[74786]: DEBUG cinder.volume.drivers.lvm [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74786) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 10 13:22:24 devstack cinder-volume[74786]: DEBUG oslo_concurrency.processutils [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74786) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:25 devstack cinder-volume[74786]: DEBUG oslo_concurrency.processutils [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] CMD "cinder-rtstool verify" returned: 0 in 1.223s {{(pid=74786) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:26 devstack cinder-volume[74786]: DEBUG oslo_db.sqlalchemy.engines [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 13:22:26 devstack cinder-volume[74786]: INFO cinder.rpc [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 10 13:22:26 devstack cinder-volume[74786]: INFO cinder.rpc [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 10 13:22:26 devstack cinder-volume[74786]: WARNING stevedore.named [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 10 13:22:26 devstack cinder-volume[74786]: WARNING castellan.key_manager [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 13:22:26 devstack cinder-volume[74786]: INFO cinder.volume.manager [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 10 13:22:26 devstack cinder-volume[74786]: DEBUG oslo_db.sqlalchemy.engines [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 13:22:26 devstack cinder-volume[74786]: INFO oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Starting 1 workers
Sep 10 13:22:26 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Started child 74900 {{(pid=74786) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 10 13:22:26 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Full set of CONF: {{(pid=74786) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 10 13:22:26 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] ******************************************************************************** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 10 13:22:26 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Configuration options gathered from: {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 10 13:22:26 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 10 13:22:26 devstack cinder-volume[74900]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] ================================================================================ {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] allow_availability_zone_fallback = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] allow_compression_on_image_upload = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] allowed_direct_url_schemes     = [] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] api_rate_limit                 = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] auth_strategy                  = keystone {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] az_cache_duration              = 3600 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_availability_zone      = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_host                   = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_name                   = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_stats_polling_interval = 60 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backup_api_class               = cinder.backup.api.API {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backup_name_template           = backup-%s {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backup_use_same_host           = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backup_use_temp_snapshot       = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] chap_password                  = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] chap_username                  =  {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cinder_internal_tenant_project_id = bab055bd9daa43aeb568590964f08934 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cinder_internal_tenant_user_id = 2a0be26f87214abab6779e82a3a6cbf8 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cloned_volume_same_az          = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cluster                        = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] compression_format             = gzip {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] compute_api_class              = cinder.compute.nova.API {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] config_dir                     = [] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] config_source                  = [] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] control_exchange               = openstack {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] debug                          = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] default_availability_zone      = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] default_group_type             = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] default_volume_type            = lvmdriver-1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] driver_client_cert             = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] driver_client_cert_key         = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] driver_data_namespace          = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] driver_ssl_cert_path           = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] driver_ssl_cert_verify         = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] driver_use_ssl                 = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] enable_force_upload            = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] enable_new_services            = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] enable_unsupported_driver      = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] enabled_backends               = ['lvmdriver-1'] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] enforce_multipath_for_image_xfer = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] filter_function                = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] glance_api_insecure            = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] glance_api_servers             = ['http://192.168.122.226/image'] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] glance_api_ssl_compression     = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] glance_ca_certificates_file    = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] glance_catalog_info            = image:glance:publicURL {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] glance_certfile                = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] glance_keyfile                 = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] glance_num_retries             = 3 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] glance_request_timeout         = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] goodness_function              = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] graceful_shutdown_timeout      = 5 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] group_api_class                = cinder.group.api.API {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] host                           = devstack {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] image_compress_on_upload       = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] image_conversion_address_space_limit = 1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] image_conversion_cpu_limit     = 60 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] image_conversion_disable       = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] image_upload_use_cinder_backend = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] image_upload_use_internal_tenant = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] image_volume_cache_enabled     = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] image_volume_cache_max_count   = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] image_volume_cache_max_size_gb = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] init_host_max_objects_retrieval = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] instance_format                = [instance: %(uuid)s]  {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] iscsi_iotype                   = fileio {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] iscsi_target_flags             =  {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] iscsi_write_cache              = on {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] iser_helper                    = tgtadm {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] iser_ip_address                = 192.168.122.226 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] iser_port                      = 3260 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] log_color                      = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] log_config_append              = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] log_dir                        = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] log_file                       = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] log_options                    = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] log_rotate_interval            = 1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] log_rotate_interval_type       = days {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] log_rotation_type              = none {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] max_age                        = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] max_logfile_count              = 30 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] max_logfile_size_mb            = 200 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] max_over_subscription_ratio    = 20.0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] message_reap_interval          = 86400 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] message_ttl                    = 2592000 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] migration_create_volume_timeout_secs = 300 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] monkey_patch                   = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] monkey_patch_modules           = [] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] my_ip                          = 192.168.122.226 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] no_snapshot_gb_quota           = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] num_iser_scan_tries            = 3 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] num_shell_tries                = 3 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] num_volume_device_scan_tries   = 3 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] nvmeof_conn_info_version       = 1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] nvmet_ns_id                    = 10 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] nvmet_port_id                  = 1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] osapi_max_limit                = 1000 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] osapi_volume_ext_list          = [] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] osapi_volume_listen            = 0.0.0.0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] osapi_volume_listen_port       = 8776 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] osapi_volume_use_ssl           = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] osapi_volume_workers           = 2 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] per_volume_size_limit          = -1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] periodic_fuzzy_delay           = 60 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] periodic_interval              = 60 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] project_id_regex               = [0-9a-f\-]+ {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] public_endpoint                = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] publish_errors                 = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] quota_backup_gigabytes         = 1000 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] quota_backups                  = 10 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] quota_gigabytes                = 1000 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] quota_groups                   = 10 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] quota_snapshots                = 10 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] quota_volumes                  = 10 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] rate_limit_burst               = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] rate_limit_except_level        = CRITICAL {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] rate_limit_interval            = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] reinit_driver_count            = 3 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] replication_device             = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] report_discard_supported       = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] report_interval                = 120 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] reservation_clean_interval     = 86400 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] reservation_expire             = 86400 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] reserved_image_namespaces      = [] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] reserved_percentage            = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] rpc_response_timeout           = 120 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] run_external_periodic_tasks    = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] scst_target_driver             = iscsi {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] scst_target_iqn_name           = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] service_down_time              = 720 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] shell_completion               = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] snapshot_name_template         = snapshot-%s {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] snapshot_same_host             = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] split_loggers                  = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] state_path                     = /opt/stack/data/cinder {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] storage_availability_zone      = nova {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] storage_protocol               = iSCSI {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] syslog_log_facility            = LOG_USER {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] target_helper                  = lioadm {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] target_ip_address              = 192.168.122.226 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] target_port                    = 3260 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] target_protocol                = iscsi {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] target_secondary_ip_addresses  = [] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] trace_flags                    = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] transfer_api_class             = cinder.transfer.api.API {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] transport_url                  = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] until_refresh                  = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] use_chap_auth                  = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] use_default_quota_class        = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] use_journal                    = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] use_json                       = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] use_multipath_for_image_xfer   = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] use_stderr                     = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] use_syslog                     = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] verify_glance_signatures       = enabled {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] volume_api_class               = cinder.volume.api.API {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] volume_backend_name            = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] volume_clear                   = zero {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] volume_clear_ionice            = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] volume_clear_size              = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] volume_copy_bps_limit          = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] volume_dd_blocksize            = 1M {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] volume_name_template           = volume-%s {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] volume_service_inithost_offload = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] volume_usage_audit_period      = month {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] watch_log_file                 = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] zoning_mode                    = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_concurrency.disable_process_locking = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.admin_password = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.admin_tenant_name = admin {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.admin_token = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.admin_user  = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.auth_admin_prefix =  {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.auth_port   = 35357 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.auth_protocol = https {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.auth_section = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.auth_type   = password {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.auth_uri    = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.auth_version = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.cache       = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.certfile    = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.delay_auth_decision = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.http_connect_timeout = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.identity_uri = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.include_service_catalog = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.insecure    = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.interface   = public {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.keyfile     = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_password =  {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcache_username =  {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.region_name = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.service_token_roles_required = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.service_type = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.token_cache_time = 300 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] keystone_authtoken.www_authenticate_uri = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.backend                  = dogpile.cache.null {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.backend_argument         = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.backend_expiration_time  = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.config_prefix            = cache.oslo {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.dead_timeout             = 60.0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.debug_cache_backend      = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.enable_retry_client      = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.enable_socket_keepalive  = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.enabled                  = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.enforce_fips_mode        = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.expiration_time          = 600 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.hashclient_retry_attempts = 2 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.memcache_dead_retry      = 300 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.memcache_password        = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.memcache_pool_maxsize    = 10 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.memcache_sasl_enabled    = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.memcache_username        = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.proxies                  = [] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.redis_db                 = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.redis_password           = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.redis_sentinel_service_name = mymaster {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.redis_server             = localhost:6379 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.redis_socket_timeout     = 1.0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.redis_username           = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.retry_attempts           = 2 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.retry_delay              = 0.0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.socket_keepalive_count   = 1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.socket_keepalive_idle    = 1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.socket_keepalive_interval = 1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.tls_allowed_ciphers      = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.tls_cafile               = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.tls_certfile             = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.tls_enabled              = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cache.tls_keyfile              = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] coordination.backend_url       = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.asyncio_connection    = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.asyncio_slave_connection = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.backend               = sqlalchemy {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.connection            = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.connection_debug      = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.connection_parameters =  {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.connection_recycle_time = 3600 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.connection_trace      = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.db_inc_retry_interval = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.db_max_retries        = 20 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.db_max_retry_interval = 10 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.db_retry_interval     = 1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.max_overflow          = 50 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.max_pool_size         = 5 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.max_retries           = 10 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.mysql_wsrep_sync_wait = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.pool_timeout          = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.retry_interval        = 10 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.slave_connection      = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.sqlite_synchronous    = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] database.use_db_reconnect      = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] profiler.connection_string     = messaging:// {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] profiler.enabled               = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] profiler.es_doc_type           = notification {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] profiler.es_scroll_size        = 10000 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] profiler.es_scroll_time        = 2m {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] profiler.filter_error_trace    = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] profiler.hmac_keys             = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] profiler.sentinel_service_name = mymaster {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] profiler.socket_timeout        = 0.1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] profiler.trace_requests        = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] profiler.trace_sqlalchemy      = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] profiler_jaeger.process_tags   = {} {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] profiler_jaeger.service_name_prefix = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] profiler_otlp.service_name_prefix = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_policy.enforce_new_defaults = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74900]: INFO cinder.volume.manager [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 10 13:22:27 devstack cinder-volume[74786]: WARNING oslo_config.cfg [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_policy.enforce_scope      = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_policy.policy_default_rule = default {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_policy.policy_file        = policy.yaml {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_policy.remote_timeout     = 60.0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] privsep_osbrick.group          = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] privsep_osbrick.helper_command = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] privsep_osbrick.thread_pool_size = 3 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] privsep_osbrick.user           = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cinder_sys_admin.group         = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cinder_sys_admin.helper_command = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] cinder_sys_admin.user          = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] service_user.auth_section      = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] service_user.auth_type         = password {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] service_user.certfile          = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] service_user.collect_timing    = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] service_user.insecure          = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] service_user.keyfile           = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] service_user.send_service_user_token = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] service_user.split_loggers     = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] service_user.timeout           = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.backend_availability_zone = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.chap_password = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.chap_username =  {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.driver_client_cert = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.driver_client_cert_key = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.driver_data_namespace = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.driver_use_ssl = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.enable_unsupported_driver = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.extra_capabilities = {} {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.filter_function = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.goodness_function = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.iscsi_iotype  = fileio {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.iscsi_target_flags =  {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.iscsi_write_cache = on {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.iser_helper   = tgtadm {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.iser_ip_address = 192.168.122.226 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.iser_port     = 3260 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.lvm_mirrors   = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.lvm_share_target = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.lvm_type      = auto {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.num_shell_tries = 3 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.nvmet_port_id = 1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.replication_device = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.report_discard_supported = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.reserved_percentage = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.scst_target_driver = iscsi {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.scst_target_iqn_name = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.storage_protocol = iSCSI {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.target_helper = tgtadm {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.target_ip_address = 192.168.122.226 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.target_port   = 3260 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.target_protocol = iscsi {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.trace_flags   = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.unique_fqdn_network = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.use_chap_auth = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.volume_backend_name = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.volume_clear  = zero {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.volume_clear_ionice = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.volume_clear_size = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.volume_group  = cinder-volumes {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_reports.file_event_handler = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_reports.log_dir           = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.backend_availability_zone = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.backend_host       = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.chap_password      = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.chap_username      = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.chiscsi_conf       = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.driver_client_cert = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.driver_data_namespace = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.driver_use_ssl     = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.extra_capabilities = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.filter_function    = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.goodness_function  = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.iscsi_iotype       = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.iser_helper        = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.iser_ip_address    = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.iser_port          = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.iser_target_prefix = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.lvm_conf_file      = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.lvm_mirrors        = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.lvm_share_target   = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.lvm_type           = auto {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.num_shell_tries    = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.nvmet_port_id      = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.replication_device = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.report_discard_supported = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.reserved_percentage = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.scst_target_driver = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.storage_protocol   = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.target_helper      = lioadm {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.target_ip_address  = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.target_port        = 3260 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.target_protocol    = iscsi {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.trace_flags        = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.use_chap_auth      = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.volume_clear       = zero {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.volume_clear_size  = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] lvmdriver-1.volumes_dir        = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.218s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.ssl      = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_notifications.driver = [] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_notifications.retry = -1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] oslo_messaging_notifications.transport_url = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] key_manager.fixed_key          = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.barbican_api_version  = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.barbican_endpoint     = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.barbican_endpoint_type = public {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.barbican_region_name  = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.cafile                = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.certfile              = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.collect_timing        = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.insecure              = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.keyfile               = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.number_of_retries     = 60 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.retry_delay           = 1 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.send_service_user_token = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.split_loggers         = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.timeout               = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.verify_ssl            = True {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican.verify_ssl_path       = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican_service_user.auth_section = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican_service_user.auth_type = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican_service_user.cafile   = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican_service_user.certfile = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican_service_user.collect_timing = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican_service_user.insecure = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican_service_user.keyfile  = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican_service_user.split_loggers = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] barbican_service_user.timeout  = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] vault.approle_role_id          = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] vault.approle_secret_id        = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] vault.kv_mountpoint            = secret {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] vault.kv_path                  = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] vault.kv_version               = 2 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] vault.namespace                = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] vault.root_token_id            = **** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] vault.ssl_ca_crt_file          = None {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] vault.timeout                  = 60.0 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] vault.use_ssl                  = False {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:22:27 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] ******************************************************************************** {{(pid=74786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 10 13:22:27 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.147s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:27 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:27 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.095s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:27 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:28 devstack sudo[74954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 10 13:22:28 devstack sudo[74954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:22:30 devstack sudo[74954]: pam_unix(sudo:session): session closed for user root
Sep 10 13:22:30 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.275s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:30 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:30 devstack sudo[75104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 13:22:30 devstack sudo[75104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:22:32 devstack sudo[75104]: pam_unix(sudo:session): session closed for user root
Sep 10 13:22:32 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 2.072s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:32 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 13:22:32 devstack cinder-volume[74900]: INFO cinder.brick.local_dev.lvm [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 10 13:22:32 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:32 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.102s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:32 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:32 devstack sudo[75196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 13:22:32 devstack sudo[75196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:22:34 devstack sudo[75196]: pam_unix(sudo:session): session closed for user root
Sep 10 13:22:34 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.120s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:34 devstack cinder-volume[74900]: DEBUG cinder.brick.local_dev.lvm [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=74900) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 10 13:22:34 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:34 devstack sudo[75284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 13:22:34 devstack sudo[75284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:22:36 devstack cinder-volume[74786]: DEBUG dbcounter [-] [74786] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74786) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:22:38 devstack sudo[75284]: pam_unix(sudo:session): session closed for user root
Sep 10 13:22:38 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.735s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:38 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:38 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.090s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:38 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:38 devstack sudo[75482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 13:22:38 devstack sudo[75482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:22:40 devstack sudo[75482]: pam_unix(sudo:session): session closed for user root
Sep 10 13:22:40 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.275s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:40 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:40 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.125s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:40 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:41 devstack sudo[75519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 10 13:22:41 devstack sudo[75519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:22:43 devstack sudo[75519]: pam_unix(sudo:session): session closed for user root
Sep 10 13:22:43 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.475s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:43 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:43 devstack sudo[75556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 13:22:43 devstack sudo[75556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:22:47 devstack sudo[75556]: pam_unix(sudo:session): session closed for user root
Sep 10 13:22:47 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.602s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:47 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:47 devstack sudo[75644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 13:22:47 devstack sudo[75644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:22:49 devstack sudo[75644]: pam_unix(sudo:session): session closed for user root
Sep 10 13:22:49 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.558s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:49 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:49 devstack sudo[75648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:22:49 devstack sudo[75648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:22:53 devstack sudo[75648]: pam_unix(sudo:session): session closed for user root
Sep 10 13:22:53 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 3.437s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:53 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:53 devstack sudo[75652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 13:22:53 devstack sudo[75652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:22:55 devstack sudo[75652]: pam_unix(sudo:session): session closed for user root
Sep 10 13:22:55 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.645s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:55 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:56 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.151s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:56 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:56 devstack sudo[75658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 13:22:56 devstack sudo[75658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:22:58 devstack sudo[75658]: pam_unix(sudo:session): session closed for user root
Sep 10 13:22:58 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.442s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:58 devstack cinder-volume[74900]: INFO cinder.volume.drivers.lvm [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 10 13:22:58 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:58 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.095s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:22:58 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:22:58 devstack sudo[75742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 13:22:58 devstack sudo[75742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:23:00 devstack sudo[75742]: pam_unix(sudo:session): session closed for user root
Sep 10 13:23:01 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.271s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:23:01 devstack cinder-volume[74900]: DEBUG cinder.volume.drivers.lvm [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Updating volume stats {{(pid=74900) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 13:23:01 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:23:01 devstack sudo[75844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 13:23:01 devstack sudo[75844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:23:03 devstack sudo[75844]: pam_unix(sudo:session): session closed for user root
Sep 10 13:23:03 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.252s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:23:03 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:23:03 devstack sudo[75953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:23:03 devstack sudo[75953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:23:05 devstack sudo[75953]: pam_unix(sudo:session): session closed for user root
Sep 10 13:23:05 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.181s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:23:05 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:23:05 devstack sudo[75956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 13:23:05 devstack sudo[75956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:23:07 devstack sudo[75956]: pam_unix(sudo:session): session closed for user root
Sep 10 13:23:07 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.125s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:23:07 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:23:07 devstack sudo[75962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:23:07 devstack sudo[75962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:23:09 devstack sudo[75962]: pam_unix(sudo:session): session closed for user root
Sep 10 13:23:09 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.212s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:23:10 devstack cinder-volume[74900]: INFO cinder.volume.driver [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Driver hasn't implemented _init_vendor_properties()
Sep 10 13:23:10 devstack cinder-volume[74900]: DEBUG cinder.volume.driver [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=74900) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 10 13:23:10 devstack cinder-volume[74900]: DEBUG oslo_db.sqlalchemy.engines [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74900) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 13:23:10 devstack cinder-volume[74900]: DEBUG dbcounter [-] [74900] Writer thread running {{(pid=74900) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 13:23:10 devstack cinder-volume[74900]: DEBUG cinder.db.sqlalchemy.api [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Building query based on filter {{(pid=74900) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 10 13:23:10 devstack cinder-volume[74900]: DEBUG cinder.image.image_utils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=74900) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 10 13:23:10 devstack cinder-volume[74900]: INFO cinder.keymgr.migration [None req-fafa5c78-eed4-4e13-ad6c-a8a51e64945e None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 10 13:23:10 devstack cinder-volume[74900]: DEBUG cinder.volume.drivers.lvm [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Updating volume stats {{(pid=74900) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 13:23:10 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:23:10 devstack sudo[75967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 13:23:10 devstack sudo[75967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:23:12 devstack sudo[75967]: pam_unix(sudo:session): session closed for user root
Sep 10 13:23:12 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.241s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:23:12 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:23:12 devstack sudo[75991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:23:12 devstack sudo[75991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:23:14 devstack sudo[75991]: pam_unix(sudo:session): session closed for user root
Sep 10 13:23:14 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.171s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:23:15 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:23:15 devstack sudo[76099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 13:23:15 devstack sudo[76099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:23:17 devstack sudo[76099]: pam_unix(sudo:session): session closed for user root
Sep 10 13:23:17 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.329s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:23:17 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:23:17 devstack sudo[76126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:23:17 devstack sudo[76126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:23:19 devstack sudo[76126]: pam_unix(sudo:session): session closed for user root
Sep 10 13:23:19 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.250s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:23:19 devstack cinder-volume[74900]: DEBUG cinder.manager [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Notifying Schedulers of capabilities ... {{(pid=74900) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:23:19 devstack cinder-volume[74900]: INFO cinder.volume.manager [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Driver initialization completed successfully.
Sep 10 13:23:19 devstack cinder-volume[74900]: INFO cinder.manager [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Initiating service 2 cleanup
Sep 10 13:23:19 devstack cinder-volume[74900]: INFO cinder.manager [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Service 2 cleanup completed.
Sep 10 13:23:19 devstack cinder-volume[74900]: DEBUG cinder.service [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Creating RPC server for service cinder-volume {{(pid=74900) start /opt/stack/cinder/cinder/service.py:239}}
Sep 10 13:23:19 devstack cinder-volume[74900]: DEBUG cinder.service [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=74900) start /opt/stack/cinder/cinder/service.py:245}}
Sep 10 13:23:20 devstack cinder-volume[74900]: INFO cinder.volume.manager [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 10 13:23:20 devstack cinder-volume[74900]: DEBUG cinder.volume.drivers.lvm [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Updating volume stats {{(pid=74900) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 13:23:20 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:23:20 devstack sudo[76129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 13:23:20 devstack sudo[76129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:23:22 devstack sudo[76129]: pam_unix(sudo:session): session closed for user root
Sep 10 13:23:22 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.059s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:23:22 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:23:22 devstack sudo[76137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:23:22 devstack sudo[76137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:23:24 devstack sudo[76137]: pam_unix(sudo:session): session closed for user root
Sep 10 13:23:24 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.223s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:23:24 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:23:24 devstack sudo[76140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 13:23:24 devstack sudo[76140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:23:26 devstack sudo[76140]: pam_unix(sudo:session): session closed for user root
Sep 10 13:23:26 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.062s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:23:26 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:23:26 devstack sudo[76148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:23:26 devstack sudo[76148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:23:28 devstack sudo[76148]: pam_unix(sudo:session): session closed for user root
Sep 10 13:23:28 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.049s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:23:28 devstack cinder-volume[74900]: DEBUG dbcounter [-] [74900] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74900) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:23:28 devstack cinder-volume[74900]: INFO cinder.volume.manager [None req-7f5d61d9-bfbb-49b6-b49e-75d181ad6cd2 None None] Driver post RPC initialization completed successfully.
Sep 10 13:23:38 devstack cinder-volume[74900]: DEBUG dbcounter [-] [74900] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=74900) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:24:15 devstack cinder-volume[74900]: DEBUG oslo_service.periodic_task [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74900) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:24:15 devstack cinder-volume[74900]: DEBUG cinder.volume.drivers.lvm [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Updating volume stats {{(pid=74900) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 13:24:15 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:24:15 devstack sudo[77122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 13:24:15 devstack sudo[77122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:24:18 devstack sudo[77122]: pam_unix(sudo:session): session closed for user root
Sep 10 13:24:18 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.331s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:24:18 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:24:18 devstack sudo[77133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:24:18 devstack sudo[77133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:24:20 devstack sudo[77133]: pam_unix(sudo:session): session closed for user root
Sep 10 13:24:20 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.345s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:24:20 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:24:20 devstack sudo[77145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 13:24:20 devstack sudo[77145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:24:22 devstack sudo[77145]: pam_unix(sudo:session): session closed for user root
Sep 10 13:24:22 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.094s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:24:22 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:24:22 devstack sudo[77148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:24:22 devstack sudo[77148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:24:24 devstack sudo[77148]: pam_unix(sudo:session): session closed for user root
Sep 10 13:24:24 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.051s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:24:24 devstack cinder-volume[74900]: DEBUG cinder.manager [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Notifying Schedulers of capabilities ... {{(pid=74900) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:25:15 devstack cinder-volume[74900]: DEBUG oslo_service.periodic_task [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74900) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:25:15 devstack cinder-volume[74900]: DEBUG cinder.volume.drivers.lvm [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Updating volume stats {{(pid=74900) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 13:25:15 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:25:15 devstack sudo[78091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 13:25:15 devstack sudo[78091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:25:17 devstack sudo[78091]: pam_unix(sudo:session): session closed for user root
Sep 10 13:25:17 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.135s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:25:18 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:25:18 devstack sudo[78124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:25:18 devstack sudo[78124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:25:20 devstack sudo[78124]: pam_unix(sudo:session): session closed for user root
Sep 10 13:25:20 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.249s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:25:20 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:25:20 devstack sudo[78127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 13:25:20 devstack sudo[78127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:25:22 devstack sudo[78127]: pam_unix(sudo:session): session closed for user root
Sep 10 13:25:22 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.985s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:25:22 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:25:22 devstack sudo[78148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:25:22 devstack sudo[78148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:25:24 devstack sudo[78148]: pam_unix(sudo:session): session closed for user root
Sep 10 13:25:24 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.094s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:25:24 devstack cinder-volume[74900]: DEBUG cinder.manager [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Notifying Schedulers of capabilities ... {{(pid=74900) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:25:38 devstack cinder-volume[74900]: DEBUG dbcounter [-] [74900] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=74900) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:26:15 devstack cinder-volume[74900]: DEBUG oslo_service.periodic_task [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74900) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:26:15 devstack cinder-volume[74900]: DEBUG cinder.volume.drivers.lvm [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Updating volume stats {{(pid=74900) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 13:26:15 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:26:15 devstack sudo[79446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 13:26:15 devstack sudo[79446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:26:17 devstack sudo[79446]: pam_unix(sudo:session): session closed for user root
Sep 10 13:26:18 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.167s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:26:18 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:26:18 devstack sudo[79592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:26:18 devstack sudo[79592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:26:20 devstack sudo[79592]: pam_unix(sudo:session): session closed for user root
Sep 10 13:26:20 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.191s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:26:20 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:26:20 devstack sudo[79737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 13:26:20 devstack sudo[79737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:26:22 devstack sudo[79737]: pam_unix(sudo:session): session closed for user root
Sep 10 13:26:22 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.259s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:26:22 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:26:22 devstack sudo[79895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:26:22 devstack sudo[79895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:26:24 devstack sudo[79895]: pam_unix(sudo:session): session closed for user root
Sep 10 13:26:24 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.127s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:26:24 devstack cinder-volume[74900]: DEBUG cinder.manager [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Notifying Schedulers of capabilities ... {{(pid=74900) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:27:15 devstack cinder-volume[74900]: DEBUG oslo_service.periodic_task [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74900) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:27:15 devstack cinder-volume[74900]: DEBUG cinder.volume.drivers.lvm [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Updating volume stats {{(pid=74900) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 13:27:15 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:27:15 devstack sudo[81342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 13:27:15 devstack sudo[81342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:27:17 devstack sudo[81342]: pam_unix(sudo:session): session closed for user root
Sep 10 13:27:17 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.001s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:27:17 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:27:17 devstack sudo[81361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:27:17 devstack sudo[81361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:27:19 devstack sudo[81361]: pam_unix(sudo:session): session closed for user root
Sep 10 13:27:19 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.848s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:27:19 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:27:19 devstack sudo[81370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 13:27:19 devstack sudo[81370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:27:21 devstack sudo[81370]: pam_unix(sudo:session): session closed for user root
Sep 10 13:27:21 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.221s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:27:22 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:27:22 devstack sudo[81381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:27:22 devstack sudo[81381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:27:24 devstack sudo[81381]: pam_unix(sudo:session): session closed for user root
Sep 10 13:27:24 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.220s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:27:24 devstack cinder-volume[74900]: DEBUG cinder.manager [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Notifying Schedulers of capabilities ... {{(pid=74900) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:27:38 devstack cinder-volume[74900]: DEBUG dbcounter [-] [74900] Writing DB stats cinder:SELECT=1 {{(pid=74900) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:27:38 devstack cinder-volume[74900]: DEBUG dbcounter [-] [74900] Writing DB stats cinder:UPDATE=1 {{(pid=74900) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:28:15 devstack cinder-volume[74900]: DEBUG oslo_service.periodic_task [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74900) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:28:15 devstack cinder-volume[74900]: DEBUG cinder.volume.drivers.lvm [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Updating volume stats {{(pid=74900) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 13:28:15 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:28:16 devstack sudo[81614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 13:28:16 devstack sudo[81614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:28:18 devstack sudo[81614]: pam_unix(sudo:session): session closed for user root
Sep 10 13:28:18 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.239s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:28:18 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:28:18 devstack sudo[81624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:28:18 devstack sudo[81624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:28:20 devstack sudo[81624]: pam_unix(sudo:session): session closed for user root
Sep 10 13:28:20 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.070s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:28:20 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:28:20 devstack sudo[81627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 13:28:20 devstack sudo[81627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:28:22 devstack sudo[81627]: pam_unix(sudo:session): session closed for user root
Sep 10 13:28:22 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.160s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:28:22 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:28:22 devstack sudo[81630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:28:22 devstack sudo[81630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:28:24 devstack sudo[81630]: pam_unix(sudo:session): session closed for user root
Sep 10 13:28:24 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.198s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:28:24 devstack cinder-volume[74900]: DEBUG cinder.manager [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Notifying Schedulers of capabilities ... {{(pid=74900) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:29:15 devstack cinder-volume[74900]: DEBUG oslo_service.periodic_task [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74900) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:29:15 devstack cinder-volume[74900]: DEBUG cinder.volume.drivers.lvm [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Updating volume stats {{(pid=74900) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 13:29:15 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:29:16 devstack sudo[82463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 13:29:16 devstack sudo[82463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:29:18 devstack sudo[82463]: pam_unix(sudo:session): session closed for user root
Sep 10 13:29:18 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.006s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:29:18 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:29:19 devstack sudo[82509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:29:19 devstack sudo[82509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:29:21 devstack sudo[82509]: pam_unix(sudo:session): session closed for user root
Sep 10 13:29:21 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.817s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:29:21 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:29:21 devstack sudo[82544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 13:29:21 devstack sudo[82544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:29:23 devstack cinder-volume[74786]: INFO oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Caught SIGTERM, stopping children
Sep 10 13:29:23 devstack cinder-volume[74786]: DEBUG oslo_concurrency.lockutils [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Acquiring lock "singleton_lock" {{(pid=74786) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 13:29:23 devstack cinder-volume[74786]: DEBUG oslo_concurrency.lockutils [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Acquired lock "singleton_lock" {{(pid=74786) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 13:29:23 devstack cinder-volume[74786]: DEBUG oslo_concurrency.lockutils [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Releasing lock "singleton_lock" {{(pid=74786) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 13:29:23 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Stop services. {{(pid=74786) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 10 13:29:23 devstack cinder-volume[74786]: DEBUG oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Killing children. {{(pid=74786) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 10 13:29:23 devstack cinder-volume[74786]: INFO oslo_service.backend._eventlet.service [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Waiting on 1 children to exit
Sep 10 13:29:25 devstack sudo[82544]: pam_unix(sudo:session): session closed for user root
Sep 10 13:29:25 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 4.218s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:29:26 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:29:26 devstack sudo[82601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 13:29:26 devstack sudo[82601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:29:28 devstack cinder-volume[74900]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Sep 10 13:29:32 devstack sudo[82601]: pam_unix(sudo:session): session closed for user root
Sep 10 13:29:32 devstack cinder-volume[74900]: DEBUG oslo_concurrency.processutils [None req-019787d9-31d4-4354-9770-5a3606db422e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 6.309s {{(pid=74900) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:29:32 devstack cinder-volume[74900]: DEBUG cinder.manager [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Notifying Schedulers of capabilities ... {{(pid=74900) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo.messaging._drivers.impl_rabbit [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo.messaging._drivers.impl_rabbit [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Unable to connect to AMQP server on 192.168.122.226:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task [None req-019787d9-31d4-4354-9770-5a3606db422e None None] Error during VolumeManager.publish_service_capabilities: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.226:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task Traceback (most recent call last):
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1173, in ensure
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     ret, channel = autoretry_method()
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 556, in _ensured
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     return fun(*args, **kwargs)
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 639, in __call__
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     return fun(*args, channel=channels[0], **kwargs), channels[0]
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in execute_method
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     method()
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1624, in _publish
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     self._producer.publish(
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 190, in publish
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     return _publish(
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 214, in _publish
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     return channel.basic_publish(
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 99, in wait
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     self.connection.drain_events(timeout=timeout)
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 526, in drain_events
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     while not self.blocking_read(timeout):
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 532, in blocking_read
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     return self.on_inbound_frame(frame)
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/method_framing.py", line 53, in on_frame
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     callback(channel, method_sig, buf, None)
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 538, in on_inbound_method
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     return self.channels[channel_id].dispatch_method(
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     listener(*args)
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 293, in _on_close
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     raise error_for_code(
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task 
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task 
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task Traceback (most recent call last):
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     task(self, context)
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/cinder/cinder/volume/manager.py", line 2873, in publish_service_capabilities
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     self._publish_service_capabilities(context)
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     self.scheduler_rpcapi.update_service_capabilities(
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 154, in cast
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     self.transport._send(self.target, msg_ctxt, msg,
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     return self._driver.send(target, ctxt, message,
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     return self._send(target, ctxt, message, wait_for_reply, timeout,
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     conn.fanout_send(target.topic, msg, retry=retry)
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1743, in fanout_send
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _ensure_publishing
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     self.ensure(method, retry=retry, error_callback=_error_callback)
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1195, in ensure
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task     raise exceptions.MessageDeliveryFailure(msg)
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.226:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 10 13:29:32 devstack cinder-volume[74900]: ERROR oslo_service.periodic_task 
Sep 10 13:29:32 devstack cinder-volume[74900]: DEBUG oslo_concurrency.lockutils [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Acquiring lock "singleton_lock" {{(pid=74900) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 13:29:32 devstack cinder-volume[74900]: DEBUG oslo_concurrency.lockutils [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Acquired lock "singleton_lock" {{(pid=74900) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 13:29:32 devstack cinder-volume[74900]: DEBUG oslo_concurrency.lockutils [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Releasing lock "singleton_lock" {{(pid=74900) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 13:29:32 devstack cinder-volume[74900]: WARNING amqp [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 10 13:29:32 devstack cinder-volume[74900]: WARNING amqp [None req-b2b980c7-9835-4857-bfda-804b9b6166dc None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 10 13:29:45 devstack cinder-volume[82608]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 13:29:45 devstack cinder-volume[82608]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 13:29:45 devstack cinder-volume[82608]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 13:29:48 devstack cinder-volume[82608]: INFO dbcounter [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] Registered counter for database cinder
Sep 10 13:29:48 devstack cinder-volume[82608]: DEBUG oslo_db.sqlalchemy.engines [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82608) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 13:29:49 devstack cinder-volume[82608]: DEBUG dbcounter [-] [82608] Writer thread running {{(pid=82608) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 13:29:49 devstack cinder-volume[82608]: INFO cinder.rpc [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 10 13:29:49 devstack cinder-volume[82608]: INFO cinder.rpc [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 10 13:29:49 devstack cinder-volume[82608]: DEBUG oslo_db.sqlalchemy.engines [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82608) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 13:29:49 devstack cinder-volume[82608]: INFO cinder.volume.manager [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] Determined volume DB was empty at startup.
Sep 10 13:29:49 devstack cinder-volume[82608]: DEBUG cinder.volume.manager [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82608) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 10 13:29:49 devstack cinder-volume[82608]: INFO cinder.volume.manager [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 10 13:29:49 devstack cinder-volume[82608]: WARNING stevedore.named [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 10 13:29:49 devstack cinder-volume[82608]: WARNING castellan.key_manager [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 13:29:49 devstack cinder-volume[82608]: WARNING cinder.keymgr.conf_key_mgr [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 13:29:50 devstack cinder-volume[82608]: INFO cinder.volume.manager [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_db.sqlalchemy.engines [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82608) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 13:29:50 devstack cinder-volume[82608]: INFO oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] Starting 1 workers
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] Started child 82823 {{(pid=82608) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] Full set of CONF: {{(pid=82608) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] ******************************************************************************** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] Configuration options gathered from: {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] ================================================================================ {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] allow_availability_zone_fallback = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] allow_compression_on_image_upload = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] allowed_direct_url_schemes     = [] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] api_rate_limit                 = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] auth_strategy                  = keystone {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_availability_zone      = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_host                   = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_name                   = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_stats_polling_interval = 60 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backup_api_class               = cinder.backup.api.API {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backup_name_template           = backup-%s {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backup_use_same_host           = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backup_use_temp_snapshot       = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] chap_password                  = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] chap_username                  =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cinder_internal_tenant_project_id = bab055bd9daa43aeb568590964f08934 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cinder_internal_tenant_user_id = 2a0be26f87214abab6779e82a3a6cbf8 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cluster                        = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] compression_format             = gzip {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] compute_api_class              = cinder.compute.nova.API {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] config_dir                     = [] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] config_source                  = [] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] control_exchange               = openstack {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] debug                          = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] default_availability_zone      = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] default_group_type             = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] default_volume_type            = QuobyteHD {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] driver_client_cert             = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:50 devstack cinder-volume[82823]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] driver_client_cert_key         = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] driver_data_namespace          = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] driver_ssl_cert_path           = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] driver_ssl_cert_verify         = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] driver_use_ssl                 = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] enable_new_services            = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] enable_unsupported_driver      = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] enabled_backends               = ['QuobyteHD'] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] enforce_multipath_for_image_xfer = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] filter_function                = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] glance_api_insecure            = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] glance_api_servers             = ['http://192.168.122.226/image'] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] glance_api_ssl_compression     = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] glance_ca_certificates_file    = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] glance_catalog_info            = image:glance:publicURL {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] glance_certfile                = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] glance_keyfile                 = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] glance_num_retries             = 3 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] glance_request_timeout         = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] goodness_function              = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] graceful_shutdown_timeout      = 5 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] group_api_class                = cinder.group.api.API {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] host                           = devstack {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] image_compress_on_upload       = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] image_conversion_address_space_limit = 1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] image_conversion_cpu_limit     = 60 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] image_conversion_disable       = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] image_upload_use_cinder_backend = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] image_upload_use_internal_tenant = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] image_volume_cache_enabled     = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] image_volume_cache_max_count   = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] image_volume_cache_max_size_gb = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] init_host_max_objects_retrieval = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] instance_format                = [instance: %(uuid)s]  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] iscsi_iotype                   = fileio {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] iscsi_target_flags             =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] iscsi_write_cache              = on {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] iser_helper                    = tgtadm {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] iser_ip_address                = 192.168.122.226 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] iser_port                      = 3260 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] log_color                      = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] log_config_append              = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] log_dir                        = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] log_file                       = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] log_options                    = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] log_rotate_interval            = 1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] log_rotate_interval_type       = days {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] log_rotation_type              = none {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] max_age                        = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] max_logfile_count              = 30 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] max_logfile_size_mb            = 200 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] max_over_subscription_ratio    = 20.0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] message_reap_interval          = 86400 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] message_ttl                    = 2592000 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] migration_create_volume_timeout_secs = 300 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] monkey_patch                   = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] monkey_patch_modules           = [] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] my_ip                          = 192.168.122.226 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] no_snapshot_gb_quota           = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] num_iser_scan_tries            = 3 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] num_shell_tries                = 3 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] num_volume_device_scan_tries   = 3 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] nvmeof_conn_info_version       = 1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] nvmet_ns_id                    = 10 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] nvmet_port_id                  = 1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] osapi_max_limit                = 1000 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] osapi_volume_ext_list          = [] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] osapi_volume_listen_port       = 8776 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] osapi_volume_use_ssl           = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] osapi_volume_workers           = 2 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] per_volume_size_limit          = -1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] periodic_fuzzy_delay           = 60 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] periodic_interval              = 60 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] public_endpoint                = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] publish_errors                 = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] quota_backup_gigabytes         = 1000 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] quota_backups                  = 10 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] quota_gigabytes                = 1000 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] quota_groups                   = 10 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] quota_snapshots                = 10 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] quota_volumes                  = 10 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] rate_limit_burst               = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] rate_limit_except_level        = CRITICAL {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] rate_limit_interval            = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] reinit_driver_count            = 3 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] replication_device             = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] report_discard_supported       = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] report_interval                = 120 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] reservation_clean_interval     = 86400 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] reservation_expire             = 86400 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] reserved_image_namespaces      = [] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] reserved_percentage            = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] rpc_response_timeout           = 120 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] run_external_periodic_tasks    = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] scst_target_driver             = iscsi {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] scst_target_iqn_name           = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] service_down_time              = 720 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] shell_completion               = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] snapshot_name_template         = snapshot-%s {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] split_loggers                  = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] state_path                     = /opt/stack/data/cinder {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] storage_availability_zone      = nova {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] storage_protocol               = iSCSI {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] syslog_log_facility            = LOG_USER {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] target_helper                  = lioadm {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] target_ip_address              = 192.168.122.226 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] target_port                    = 3260 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] target_protocol                = iscsi {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] target_secondary_ip_addresses  = [] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] trace_flags                    = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] transport_url                  = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] until_refresh                  = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] use_chap_auth                  = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] use_default_quota_class        = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] use_journal                    = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] use_json                       = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] use_multipath_for_image_xfer   = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] use_stderr                     = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] use_syslog                     = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] verify_glance_signatures       = enabled {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] volume_api_class               = cinder.volume.api.API {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] volume_backend_name            = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] volume_clear                   = zero {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] volume_clear_ionice            = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] volume_clear_size              = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] volume_copy_bps_limit          = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] volume_dd_blocksize            = 1M {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] volume_name_template           = volume-%s {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] volume_service_inithost_offload = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] volume_usage_audit_period      = month {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] watch_log_file                 = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] zoning_mode                    = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 13:29:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=82823) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_concurrency.disable_process_locking = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.admin_password = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.admin_token = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.admin_user  = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.auth_port   = 35357 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.auth_protocol = https {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.auth_section = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.auth_type   = password {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.auth_uri    = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.auth_version = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.cache       = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.certfile    = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.delay_auth_decision = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.http_connect_timeout = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.identity_uri = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.include_service_catalog = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:51 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.insecure    = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.interface   = public {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.keyfile     = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_password =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcache_username =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.region_name = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.service_token_roles_required = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.service_type = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.token_cache_time = 300 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.backend                  = dogpile.cache.null {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.backend_argument         = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.backend_expiration_time  = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.config_prefix            = cache.oslo {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.dead_timeout             = 60.0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.debug_cache_backend      = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.enable_retry_client      = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.enable_socket_keepalive  = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.enabled                  = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.enforce_fips_mode        = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.expiration_time          = 600 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.hashclient_retry_attempts = 2 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.memcache_dead_retry      = 300 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.memcache_password        = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.memcache_pool_maxsize    = 10 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.memcache_sasl_enabled    = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.memcache_username        = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.proxies                  = [] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.redis_db                 = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.redis_password           = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.redis_sentinel_service_name = mymaster {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.redis_server             = localhost:6379 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.redis_socket_timeout     = 1.0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.redis_username           = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.retry_attempts           = 2 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.retry_delay              = 0.0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.socket_keepalive_count   = 1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.socket_keepalive_idle    = 1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.socket_keepalive_interval = 1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.tls_allowed_ciphers      = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.tls_cafile               = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.tls_certfile             = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.tls_enabled              = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cache.tls_keyfile              = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] coordination.backend_url       = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.asyncio_connection    = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.asyncio_slave_connection = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.backend               = sqlalchemy {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.connection            = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.connection_debug      = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.connection_parameters =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.connection_recycle_time = 3600 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.connection_trace      = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.db_inc_retry_interval = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.db_max_retries        = 20 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.db_max_retry_interval = 10 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.db_retry_interval     = 1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.max_overflow          = 50 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.max_pool_size         = 5 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.max_retries           = 10 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.mysql_wsrep_sync_wait = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.pool_timeout          = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.retry_interval        = 10 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.slave_connection      = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.sqlite_synchronous    = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] database.use_db_reconnect      = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] profiler.connection_string     = messaging:// {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] profiler.enabled               = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] profiler.es_doc_type           = notification {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] profiler.es_scroll_size        = 10000 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] profiler.es_scroll_time        = 2m {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] profiler.filter_error_trace    = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] profiler.hmac_keys             = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] profiler.sentinel_service_name = mymaster {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] profiler.socket_timeout        = 0.1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] profiler.trace_requests        = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] profiler.trace_sqlalchemy      = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] profiler_jaeger.process_tags   = {} {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] profiler_jaeger.service_name_prefix = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] profiler_otlp.service_name_prefix = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_policy.enforce_new_defaults = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: WARNING oslo_config.cfg [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_policy.enforce_scope      = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_policy.policy_default_rule = default {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_policy.policy_file        = policy.yaml {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] privsep_osbrick.group          = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] privsep_osbrick.helper_command = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] privsep_osbrick.user           = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cinder_sys_admin.group         = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cinder_sys_admin.helper_command = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] cinder_sys_admin.user          = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] service_user.auth_section      = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] service_user.auth_type         = password {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] service_user.certfile          = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] service_user.collect_timing    = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] service_user.insecure          = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] service_user.keyfile           = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] service_user.send_service_user_token = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] service_user.split_loggers     = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] service_user.timeout           = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.backend_availability_zone = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.chap_password = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.chap_username =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.driver_client_cert = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.driver_client_cert_key = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.driver_data_namespace = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.driver_use_ssl = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.enable_unsupported_driver = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.extra_capabilities = {} {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.filter_function = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.goodness_function = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.iscsi_iotype  = fileio {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.iscsi_target_flags =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.iscsi_write_cache = on {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.iser_helper   = tgtadm {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.iser_ip_address = 192.168.122.226 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.iser_port     = 3260 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.nas_host      =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.nas_login     = admin {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.nas_mount_options = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.nas_password  = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.nas_private_key =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.nas_share_path =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.num_shell_tries = 3 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.nvmet_port_id = 1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.quobyte_client_cfg = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.quobyte_volume_url = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.replication_device = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.report_discard_supported = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.reserved_percentage = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.scst_target_driver = iscsi {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.scst_target_iqn_name = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.storage_protocol = iSCSI {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.target_helper = tgtadm {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.target_ip_address = 192.168.122.226 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.target_port   = 3260 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.target_protocol = iscsi {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.trace_flags   = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.unique_fqdn_network = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.use_chap_auth = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.volume_backend_name = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.volume_clear  = zero {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.volume_clear_ionice = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.volume_clear_size = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_reports.file_event_handler = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_reports.log_dir           = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.backend_availability_zone = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.backend_host         = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.chap_password        = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.chap_username        = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.chiscsi_conf         = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.driver_client_cert   = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.driver_client_cert_key = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.driver_data_namespace = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.driver_use_ssl       = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.extra_capabilities   = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.filter_function      = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.goodness_function    = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.iscsi_iotype         = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=82823) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 10 13:29:52 devstack cinder-volume[82823]: INFO cinder.volume.drivers.quobyte [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.iser_helper          = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.iser_ip_address      = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.iser_port            = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.iser_target_prefix   = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.nas_host             = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.nas_login            = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.nas_mount_options    = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.nas_password         = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.nas_private_key      = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.nas_share_path       = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.nas_ssh_port         = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Running cmd (subprocess): mount.quobyte {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.num_shell_tries      = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.nvmet_port_id        = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.replication_device   = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.report_discard_supported = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.reserved_percentage  = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.scst_target_driver   = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.storage_protocol     = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.target_helper        = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.target_ip_address    = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.target_port          = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.target_prefix        = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.target_protocol      = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.trace_flags          = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.use_chap_auth        = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.volume_clear         = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.volume_clear_size    = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] QuobyteHD.volumes_dir          = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.ssl      = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_notifications.driver = [] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_notifications.retry = -1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] oslo_messaging_notifications.transport_url = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] key_manager.fixed_key          = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.barbican_api_version  = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.barbican_endpoint     = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.barbican_endpoint_type = public {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.barbican_region_name  = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.cafile                = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.certfile              = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.collect_timing        = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.insecure              = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.keyfile               = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.number_of_retries     = 60 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.retry_delay           = 1 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.send_service_user_token = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.split_loggers         = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.timeout               = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.verify_ssl            = True {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican.verify_ssl_path       = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican_service_user.auth_section = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican_service_user.auth_type = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican_service_user.cafile   = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican_service_user.certfile = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican_service_user.collect_timing = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican_service_user.insecure = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican_service_user.keyfile  = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican_service_user.split_loggers = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] barbican_service_user.timeout  = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] vault.approle_role_id          = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] vault.approle_secret_id        = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] vault.kv_mountpoint            = secret {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] vault.kv_path                  = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] vault.kv_version               = 2 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] vault.namespace                = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] vault.root_token_id            = **** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] vault.ssl_ca_crt_file          = None {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] vault.timeout                  = 60.0 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] vault.use_ssl                  = False {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 13:29:52 devstack cinder-volume[82608]: DEBUG oslo_service.backend._eventlet.service [None req-126b8e9e-cd50-4ac0-9a34-596e6a572fac None None] ******************************************************************************** {{(pid=82608) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 10 13:29:53 devstack quobyte-client[82837]: Reading configuration file: /etc/quobyte/client.cfg
Sep 10 13:29:53 devstack quobyte-client[82837]: Invalid parameters found, error: missing mount point.
Sep 10 13:29:53 devstack quobyte-client[82837]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 10 13:29:53 devstack quobyte-client[82837]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 10 13:29:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] CMD "mount.quobyte" returned: 1 in 0.747s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:29:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:29:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:29:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:29:53 devstack cinder-volume[82823]: INFO cinder.volume.drivers.quobyte [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Mounting volume: 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 ...
Sep 10 13:29:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c -c /etc/quobyte/client-cinder.cfg {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:29:53 devstack quobyte-client[82842]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 10 13:29:53 devstack quobyte-client[82842]: Reading configuration file: /etc/quobyte/client.cfg
Sep 10 13:29:53 devstack quobyte-client[82842]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c' to display the log.
Sep 10 13:29:53 devstack quobyte-client[82845]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 10 13:29:53 devstack quobyte-client[82845]: mount.quobyte 3.25 (4fbbd59204)
Sep 10 13:29:53 devstack quobyte-client[82845]: Client UUID: OMUpal0Y-IrSD-8IDe-dL2G-0LI5XOryxxIX
Sep 10 13:29:53 devstack quobyte-client[82845]: Registry: osci01.corp.quobyte.com:7861
Sep 10 13:29:53 devstack quobyte-client[82845]: Volume: cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:29:53 devstack quobyte-client[82845]: FUSE version: 316
Sep 10 13:29:53 devstack quobyte-client[82845]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 10 13:29:53 devstack quobyte-client[82845]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 10 13:29:53 devstack quobyte-client[82845]: Setting total object cache size to 3352297472 bytes
Sep 10 13:29:53 devstack quobyte-client[82845]: Using FUSE low-level API
Sep 10 13:29:53 devstack quobyte-client[82845]: Caching of uid/gid to user/group name mappings is enabled
Sep 10 13:29:53 devstack quobyte-client[82845]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 10 13:29:53 devstack quobyte-client[82845]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 10 13:29:53 devstack quobyte-client[82845]: HTTP server started on port 55000
Sep 10 13:29:53 devstack quobyte-client[82845]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 10 13:29:53 devstack quobyte-client[82845]: Mount point /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c established
Sep 10 13:29:53 devstack quobyte-client[82845]: TimeSync is running and remote sync every 60 seconds
Sep 10 13:29:54 devstack quobyte-client[82845]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 13:29:54 devstack quobyte-client[82845]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 13:29:54 devstack quobyte-client[82845]: Opening volume cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 (fcc52668-bcd4-45ac-8e70-66f794d7241f)
Sep 10 13:29:54 devstack quobyte-client[82845]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 10 13:29:54 devstack quobyte-client[82845]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 13:29:54 devstack quobyte-client[82845]: Failed to invalidate inode: 38: Function not implemented
Sep 10 13:29:54 devstack quobyte-client[82845]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 13:29:54 devstack quobyte-client[82845]: Automatic minidump upload enabled by global system configuration
Sep 10 13:29:54 devstack quobyte-client[82845]: Announcing HTTP status server address 172.24.4.1
Sep 10 13:29:54 devstack quobyte-client[82845]: Registered as service (uuid OMUpal0Y-IrSD-8IDe-dL2G-0LI5XOryxxIX)
Sep 10 13:29:54 devstack quobyte-client[82845]: Quobyte Client running as pid 82845
Sep 10 13:29:54 devstack quobyte-client[82845]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 10 13:29:54 devstack quobyte-client[82845]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 10 13:29:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.935s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:29:54 devstack cinder-volume[82823]: INFO cinder.volume.drivers.quobyte [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Mounting volume: 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 succeeded
Sep 10 13:29:54 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:29:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 1.034s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:29:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:29:54 devstack quobyte-client[82845]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 13:29:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.156s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:29:54 devstack cinder-volume[82823]: INFO cinder.volume.driver [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Driver hasn't implemented _init_vendor_properties()
Sep 10 13:29:54 devstack cinder-volume[82823]: DEBUG cinder.volume.driver [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.910228729248, 'free_capacity_gb': 924.910228729248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82823) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 10 13:29:54 devstack cinder-volume[82823]: DEBUG oslo_db.sqlalchemy.engines [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82823) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 13:29:55 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writer thread running {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 13:29:55 devstack cinder-volume[82823]: DEBUG cinder.db.sqlalchemy.api [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Building query based on filter {{(pid=82823) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 10 13:29:55 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82823) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 10 13:29:55 devstack cinder-volume[82823]: INFO cinder.keymgr.migration [None req-a04625f1-9995-49d8-8b4c-973f57aff522 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 10 13:29:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:29:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:29:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:29:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:29:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:29:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:29:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.109s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:29:55 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:29:55 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Driver initialization completed successfully.
Sep 10 13:29:55 devstack cinder-volume[82823]: INFO cinder.manager [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Initiating service 3 cleanup
Sep 10 13:29:56 devstack cinder-volume[82823]: INFO cinder.manager [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Service 3 cleanup completed.
Sep 10 13:29:56 devstack cinder-volume[82823]: DEBUG cinder.service [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Creating RPC server for service cinder-volume {{(pid=82823) start /opt/stack/cinder/cinder/service.py:239}}
Sep 10 13:29:56 devstack cinder-volume[82823]: DEBUG cinder.service [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82823) start /opt/stack/cinder/cinder/service.py:245}}
Sep 10 13:29:56 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 10 13:29:56 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:29:56 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:29:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:29:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:29:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:29:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:29:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:29:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:29:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.110s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:29:56 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-1695799a-f14b-418a-bf5a-940eec1113dc None None] Driver post RPC initialization completed successfully.
Sep 10 13:29:56 devstack quobyte-client[82845]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 13:30:00 devstack cinder-volume[82608]: DEBUG dbcounter [-] [82608] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82608) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:30:06 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=3 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:30:06 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:31:00 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:31:00 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:31:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Flow 'volume_create_manager' (997c1ea0-1075-4220-a310-96aad8e654e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:31:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b7a051-e468-4f12-923c-69b5da114ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b7a051-e468-4f12-923c-69b5da114ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1526629549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f505a3-b855-4799-84de-7e651e8e4e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2c0544f7e34bdabc1aa6ea0da7ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:00Z,use_quota=True,user_id='726a2773e34348b9a3089a4a888592dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23e9dd8-c538-41b4-a49b-14a454395d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23e9dd8-c538-41b4-a49b-14a454395d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ed5637-e3c1-4baf-92c1-97ed08c770f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ed5637-e3c1-4baf-92c1-97ed08c770f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9f505a3-b855-4799-84de-7e651e8e4e24', 'volume_name': 'volume-f9f505a3-b855-4799-84de-7e651e8e4e24', 'volume_size': 1, 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02b5bb39d7434620bf21786ff3aad29c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'created_at': datetime.datetime(2025, 9, 10, 11, 23, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 23, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f8481a-df2c-4f8b-8548-87d289ce329e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95bffabdc0>}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8ca6cd-1847-4a40-8e02-f825149d70b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8ca6cd-1847-4a40-8e02-f825149d70b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf63b09-244b-4753-982c-d0559a769c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:02 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Volume f9f505a3-b855-4799-84de-7e651e8e4e24: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9f505a3-b855-4799-84de-7e651e8e4e24', 'volume_size': 1, 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02b5bb39d7434620bf21786ff3aad29c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'created_at': datetime.datetime(2025, 9, 10, 11, 23, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 23, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f8481a-df2c-4f8b-8548-87d289ce329e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95bffabdc0>}
Sep 10 13:31:02 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Cloning f9f505a3-b855-4799-84de-7e651e8e4e24 from image b4f8481a-df2c-4f8b-8548-87d289ce329e  at location (None, None). {{(pid=82823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 13:31:04 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_a4v56ygidevstack@QuobyteHD, size 20.69 MB, duration 2.78 sec {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 13:31:04 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Image download 20.69 MB at 7.45 MB/s
Sep 10 13:31:05 devstack cinder-volume[82823]: INFO oslo.privsep.daemon [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvem39d75/privsep.sock']
Sep 10 13:31:05 devstack sudo[83118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvem39d75/privsep.sock
Sep 10 13:31:05 devstack sudo[83118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:31:10 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:31:11 devstack sudo[83118]: pam_unix(sudo:session): session closed for user root
Sep 10 13:31:11 devstack cinder-volume[82823]: INFO oslo.privsep.daemon [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Spawned new privsep daemon via rootwrap
Sep 10 13:31:11 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Accepted privsep connection to /tmp/tmpvem39d75/privsep.sock {{(pid=82823) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 10 13:31:11 devstack cinder-volume[82823]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 10 13:31:11 devstack cinder-volume[82823]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 10 13:31:11 devstack cinder-volume[82823]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 10 13:31:11 devstack cinder-volume[82823]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83122
Sep 10 13:31:11 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[74921d36-74ab-4d25-9bec-504c43979fe1]: (2,) {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:31:11 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4106d26-adfb-40bb-a7c3-4d20075666d2]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:31:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_a4v56ygidevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:11 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:31:12 devstack sudo[83154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_a4v56ygidevstack@QuobyteHD
Sep 10 13:31:12 devstack sudo[83154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:31:15 devstack sudo[83154]: pam_unix(sudo:session): session closed for user root
Sep 10 13:31:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_a4v56ygidevstack@QuobyteHD" returned: 0 in 4.174s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:15 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Temporary image b4f8481a-df2c-4f8b-8548-87d289ce329e is fetched for user 726a2773e34348b9a3089a4a888592dc. {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 13:31:15 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6ddca2-d7af-42d1-b7f3-4aeab68fe3e8]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:31:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_a4v56ygidevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:16 devstack sudo[83164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_a4v56ygidevstack@QuobyteHD
Sep 10 13:31:16 devstack sudo[83164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:31:19 devstack sudo[83164]: pam_unix(sudo:session): session closed for user root
Sep 10 13:31:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_a4v56ygidevstack@QuobyteHD" returned: 0 in 3.073s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:31:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:31:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1526629549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f505a3-b855-4799-84de-7e651e8e4e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2c0544f7e34bdabc1aa6ea0da7ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:00Z,use_quota=True,user_id='726a2773e34348b9a3089a4a888592dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:31:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Creating volume f9f505a3-b855-4799-84de-7e651e8e4e24 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:31:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:31:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:31:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:31:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:31:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:31:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:31:19 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:31:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:19 devstack quobyte-client[82845]: System call of process 83176 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:31:19 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=2, name=volume-f9f505a3-b855-4799-84de-7e651e8e4e24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:31:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24 1073741824" returned: 0 in 0.974s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24" returned: 0 in 0.225s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] <== create_volume: return (1382ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:31:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:31:20 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Attempting download of b4f8481a-df2c-4f8b-8548-87d289ce329e ((None, None)) to volume f9f505a3-b855-4799-84de-7e651e8e4e24. {{(pid=82823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 13:31:21 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4047dd7-aaea-4af6-a012-89d7e454659d]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:31:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_nnb1tv9f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_nnb1tv9f" returned: 0 in 0.717s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_nnb1tv9f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_nnb1tv9f" returned: 1 in 0.892s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_nnb1tv9f' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 13:31:23 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebe5e32-d491-49e5-80e5-af5e5a1edde3]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:31:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_a4v56ygidevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_a4v56ygidevstack@QuobyteHD" returned: 0 in 0.716s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:23 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] b4f8481a-df2c-4f8b-8548-87d289ce329e was qcow2, converting to raw {{(pid=82823) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 13:31:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_a4v56ygidevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:24 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=2, name=volume-f9f505a3-b855-4799-84de-7e651e8e4e24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:31:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_a4v56ygidevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24" returned: 0 in 1.686s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:25 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_a4v56ygidevstack@QuobyteHD, size 112.00 MB, duration 1.71 sec, destination /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24 {{(pid=82823) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 13:31:25 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Converted 112.00 MB image at 65.53 MB/s
Sep 10 13:31:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24 1G" returned: 0 in 0.180s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:25 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32433e9-dbfd-4334-bf8b-10f5a7671c1e]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:31:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:26 devstack quobyte-client[82845]: System call of process 83517 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:31:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24" returned: 0 in 0.717s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24" returned: 1 in 0.565s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 13:31:27 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Downloaded image b4f8481a-df2c-4f8b-8548-87d289ce329e ((None, None)) to volume f9f505a3-b855-4799-84de-7e651e8e4e24 successfully. {{(pid=82823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 13:31:27 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Temporary image b4f8481a-df2c-4f8b-8548-87d289ce329e for user 726a2773e34348b9a3089a4a888592dc is deleted. {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 13:31:27 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Marking volume f9f505a3-b855-4799-84de-7e651e8e4e24 as bootable. {{(pid=82823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 13:31:27 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Copying metadata from image b4f8481a-df2c-4f8b-8548-87d289ce329e to f9f505a3-b855-4799-84de-7e651e8e4e24. {{(pid=82823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 13:31:27 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Creating volume glance metadata for volume f9f505a3-b855-4799-84de-7e651e8e4e24 backed by image b4f8481a-df2c-4f8b-8548-87d289ce329e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 13:31:27 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:31:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:31:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:31:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:31:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:31:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:31:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.336s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:28 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:31:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf63b09-244b-4753-982c-d0559a769c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9f505a3-b855-4799-84de-7e651e8e4e24', 'volume_size': 1, 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02b5bb39d7434620bf21786ff3aad29c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'created_at': datetime.datetime(2025, 9, 10, 11, 23, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 23, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f8481a-df2c-4f8b-8548-87d289ce329e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95bffabdc0>}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ec818f-8332-42c8-995b-e10fb32ed55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:28 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Volume volume-f9f505a3-b855-4799-84de-7e651e8e4e24 (f9f505a3-b855-4799-84de-7e651e8e4e24): created successfully
Sep 10 13:31:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ec818f-8332-42c8-995b-e10fb32ed55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Flow 'volume_create_manager' (997c1ea0-1075-4220-a310-96aad8e654e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:31:28 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-0e0f483f-4342-47da-b3b6-feced0c06fdb tempest-TaggedBootDevicesTest-158457909 None] Created volume successfully.
Sep 10 13:31:28 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:31:28 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:31:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Flow 'volume_create_manager' (8e80a5bd-a5b2-4bd3-a060-1d68e85611fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:31:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde01ac4-59dc-45d2-8341-540ac37d38d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde01ac4-59dc-45d2-8341-540ac37d38d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-284656961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541b1d0b-3799-4bba-91b1-37e025047166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8174f604ddb4f818cca3d7a86c2e74f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:29Z,use_quota=True,user_id='9422110d10b04214ac0859d01dbb2caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a6ad9a-8f2a-4685-ad6c-3672bec31f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a6ad9a-8f2a-4685-ad6c-3672bec31f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b467145-1c6b-4b96-a186-9794ef69796d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b467145-1c6b-4b96-a186-9794ef69796d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '541b1d0b-3799-4bba-91b1-37e025047166', 'volume_name': 'volume-541b1d0b-3799-4bba-91b1-37e025047166', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e5d13c-0e61-48f6-b8be-4b53dd457fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e5d13c-0e61-48f6-b8be-4b53dd457fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd1f5bc-35a9-4862-bff4-6cdd2105344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:29 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Volume 541b1d0b-3799-4bba-91b1-37e025047166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-541b1d0b-3799-4bba-91b1-37e025047166', 'volume_size': 1}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-284656961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541b1d0b-3799-4bba-91b1-37e025047166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8174f604ddb4f818cca3d7a86c2e74f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:29Z,use_quota=True,user_id='9422110d10b04214ac0859d01dbb2caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Creating volume 541b1d0b-3799-4bba-91b1-37e025047166 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:31:29 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-541b1d0b-3799-4bba-91b1-37e025047166 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:29 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=3, name=volume-541b1d0b-3799-4bba-91b1-37e025047166, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-541b1d0b-3799-4bba-91b1-37e025047166 1073741824" returned: 0 in 0.454s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-541b1d0b-3799-4bba-91b1-37e025047166 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-541b1d0b-3799-4bba-91b1-37e025047166" returned: 0 in 0.142s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] <== create_volume: return (677ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:31:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd1f5bc-35a9-4862-bff4-6cdd2105344b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-541b1d0b-3799-4bba-91b1-37e025047166', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e2d8cd-a3c8-402c-a5a9-2d85350f9378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:30 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Volume volume-541b1d0b-3799-4bba-91b1-37e025047166 (541b1d0b-3799-4bba-91b1-37e025047166): created successfully
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e2d8cd-a3c8-402c-a5a9-2d85350f9378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Flow 'volume_create_manager' (8e80a5bd-a5b2-4bd3-a060-1d68e85611fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:31:30 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-095eda9a-7cec-4f00-8af7-59dd7b2dad51 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Created volume successfully.
Sep 10 13:31:30 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Flow 'volume_create_manager' (7553a614-fd6b-4eac-8312-7431e2b28775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011b5a2f-587b-4b88-9177-839d3e4c87b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011b5a2f-587b-4b88-9177-839d3e4c87b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1157376783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a496adbb-7cc7-4f4b-8646-db5e527cc05a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2c0544f7e34bdabc1aa6ea0da7ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:30Z,use_quota=True,user_id='726a2773e34348b9a3089a4a888592dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e842ae9-58c3-44e0-933a-b6f770424e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e842ae9-58c3-44e0-933a-b6f770424e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4347e9-ceae-472d-a140-6bfe9d0ad8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4347e9-ceae-472d-a140-6bfe9d0ad8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a496adbb-7cc7-4f4b-8646-db5e527cc05a', 'volume_name': 'volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189834a7-a033-44c2-9f8c-79cf8fa790f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189834a7-a033-44c2-9f8c-79cf8fa790f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8973a89c-ea7b-4c9c-83cf-630b83b580a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:30 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Volume a496adbb-7cc7-4f4b-8646-db5e527cc05a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a', 'volume_size': 1}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1157376783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a496adbb-7cc7-4f4b-8646-db5e527cc05a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2c0544f7e34bdabc1aa6ea0da7ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:30Z,use_quota=True,user_id='726a2773e34348b9a3089a4a888592dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Creating volume a496adbb-7cc7-4f4b-8646-db5e527cc05a {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:31:30 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:31:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:30 devstack quobyte-client[82845]: System call of process 83531 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:31:30 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=4, name=volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:31:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a 1073741824" returned: 0 in 0.625s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a" returned: 0 in 0.219s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] <== create_volume: return (985ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:31:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:31:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8973a89c-ea7b-4c9c-83cf-630b83b580a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac386a3-966a-4523-9177-0bf655c552df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:32 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Volume volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a (a496adbb-7cc7-4f4b-8646-db5e527cc05a): created successfully
Sep 10 13:31:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac386a3-966a-4523-9177-0bf655c552df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Flow 'volume_create_manager' (7553a614-fd6b-4eac-8312-7431e2b28775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:31:32 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-94b11908-1146-41b4-a2a1-a6223dd53b25 tempest-TaggedBootDevicesTest-158457909 None] Created volume successfully.
Sep 10 13:31:33 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:31:33 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:31:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Flow 'volume_create_manager' (35915a04-4acd-4e6e-9707-938bfee15ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:31:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03423f0-dc12-4344-a4be-7a565c8b7eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03423f0-dc12-4344-a4be-7a565c8b7eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-748820264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c51995-af62-42f0-b99c-069d762e1419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2c0544f7e34bdabc1aa6ea0da7ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:34Z,use_quota=True,user_id='726a2773e34348b9a3089a4a888592dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41392666-2f1e-47a4-a1ef-678b073e2345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41392666-2f1e-47a4-a1ef-678b073e2345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5c3a44-8c91-41fa-9683-fa06e85f2288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5c3a44-8c91-41fa-9683-fa06e85f2288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69c51995-af62-42f0-b99c-069d762e1419', 'volume_name': 'volume-69c51995-af62-42f0-b99c-069d762e1419', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd9b5ca-0a20-490c-acb2-394ffd303bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd9b5ca-0a20-490c-acb2-394ffd303bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6cdd28-7659-4ce4-8185-9db9b3ee1915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:34 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Volume 69c51995-af62-42f0-b99c-069d762e1419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69c51995-af62-42f0-b99c-069d762e1419', 'volume_size': 1}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-748820264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c51995-af62-42f0-b99c-069d762e1419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2c0544f7e34bdabc1aa6ea0da7ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:31:34Z,use_quota=True,user_id='726a2773e34348b9a3089a4a888592dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Creating volume 69c51995-af62-42f0-b99c-069d762e1419 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:31:34 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-69c51995-af62-42f0-b99c-069d762e1419 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:34 devstack quobyte-client[82845]: System call of process 83557 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:31:34 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=5, name=volume-69c51995-af62-42f0-b99c-069d762e1419, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-69c51995-af62-42f0-b99c-069d762e1419 1073741824" returned: 0 in 0.572s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-69c51995-af62-42f0-b99c-069d762e1419 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:31:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-69c51995-af62-42f0-b99c-069d762e1419" returned: 0 in 0.183s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:31:35 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] <== create_volume: return (900ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:31:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:31:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6cdd28-7659-4ce4-8185-9db9b3ee1915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c51995-af62-42f0-b99c-069d762e1419', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c25113d-0b7c-4207-b908-654d7ae36b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:31:35 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Volume volume-69c51995-af62-42f0-b99c-069d762e1419 (69c51995-af62-42f0-b99c-069d762e1419): created successfully
Sep 10 13:31:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c25113d-0b7c-4207-b908-654d7ae36b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:31:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Flow 'volume_create_manager' (35915a04-4acd-4e6e-9707-938bfee15ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:31:35 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-57bfb36e-37f6-4017-bf54-4de55a222b8f tempest-TaggedBootDevicesTest-158457909 None] Created volume successfully.
Sep 10 13:31:45 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:31:45 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=11,cinder:DELETE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:32:06 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:32:06 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:32:14 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:32:14 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:32:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Flow 'volume_create_manager' (eb6e71c8-9f94-4641-9bc9-75e696db4614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:32:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0096b3f-1272-443a-bef3-ec484cd08a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:32:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0096b3f-1272-443a-bef3-ec484cd08a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1066037988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1024b316-f0dd-44b4-81ed-119b63659a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55738e852c02472681dd73ac9c94dc84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:32:13Z,use_quota=True,user_id='f717739763564966a71adcf2df101e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:32:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871a111e-b0a4-41bb-80d2-b8aae26166d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:32:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871a111e-b0a4-41bb-80d2-b8aae26166d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:32:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161a853a-8539-4c7d-8b76-415a122d175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:32:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161a853a-8539-4c7d-8b76-415a122d175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1024b316-f0dd-44b4-81ed-119b63659a3a', 'volume_name': 'volume-1024b316-f0dd-44b4-81ed-119b63659a3a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:32:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45faa45a-244e-44c1-9a83-e36a9799f967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:32:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45faa45a-244e-44c1-9a83-e36a9799f967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:32:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf0127e-44c6-439f-8b73-5f5d67c967d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:32:15 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Volume 1024b316-f0dd-44b4-81ed-119b63659a3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1024b316-f0dd-44b4-81ed-119b63659a3a', 'volume_size': 1}
Sep 10 13:32:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:32:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:32:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1066037988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1024b316-f0dd-44b4-81ed-119b63659a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55738e852c02472681dd73ac9c94dc84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:32:13Z,use_quota=True,user_id='f717739763564966a71adcf2df101e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:32:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Creating volume 1024b316-f0dd-44b4-81ed-119b63659a3a {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:32:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:32:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:32:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:32:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:32:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:32:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:32:15 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:32:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1024b316-f0dd-44b4-81ed-119b63659a3a 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:32:15 devstack quobyte-client[82845]: System call of process 83779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:32:15 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=6, name=volume-1024b316-f0dd-44b4-81ed-119b63659a3a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:32:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1024b316-f0dd-44b4-81ed-119b63659a3a 1073741824" returned: 0 in 1.700s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:32:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1024b316-f0dd-44b4-81ed-119b63659a3a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:32:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1024b316-f0dd-44b4-81ed-119b63659a3a" returned: 0 in 0.978s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:32:18 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] <== create_volume: return (3263ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:32:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.332s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:32:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf0127e-44c6-439f-8b73-5f5d67c967d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1024b316-f0dd-44b4-81ed-119b63659a3a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:32:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d918f4-a569-4652-af09-01e7a9317fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:32:19 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Volume volume-1024b316-f0dd-44b4-81ed-119b63659a3a (1024b316-f0dd-44b4-81ed-119b63659a3a): created successfully
Sep 10 13:32:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d918f4-a569-4652-af09-01e7a9317fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:32:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Flow 'volume_create_manager' (eb6e71c8-9f94-4641-9bc9-75e696db4614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:32:19 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-31f1e068-652f-4ebd-a954-bb6a6017a673 tempest-VolumesAdminNegativeTest-14521286 None] Created volume successfully.
Sep 10 13:32:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Acquiring lock "cinder-1024b316-f0dd-44b4-81ed-119b63659a3a-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:32:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Lock "cinder-1024b316-f0dd-44b4-81ed-119b63659a3a-delete_volume" acquired by "delete_volume" :: waited 0.184s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:32:23 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:32:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Acquiring lock "cinder-quobyte-1024b316-f0dd-44b4-81ed-119b63659a3a" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:32:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Lock "cinder-quobyte-1024b316-f0dd-44b4-81ed-119b63659a3a" acquired by "delete_volume" :: waited 0.125s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:32:23 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[161f4f02-3dc2-4799-88ee-e2e561196be0]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:32:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1024b316-f0dd-44b4-81ed-119b63659a3a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:32:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1024b316-f0dd-44b4-81ed-119b63659a3a" returned: 0 in 3.755s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:32:27 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:32:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:32:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:32:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:32:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:32:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:32:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:32:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1024b316-f0dd-44b4-81ed-119b63659a3a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:32:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1024b316-f0dd-44b4-81ed-119b63659a3a" returned: 0 in 0.975s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:32:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 1.679s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:32:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:32:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Lock "cinder-quobyte-1024b316-f0dd-44b4-81ed-119b63659a3a" released by "delete_volume" :: held 6.484s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:32:31 devstack cinder-volume[82823]: WARNING cinder.quota [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 10 13:32:32 devstack cinder-volume[82823]: WARNING cinder.quota [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 10 13:32:32 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Created reservations ['94d9930c-df06-4eea-84e5-353ace3ee5b9', '8ce7ec13-1c1e-44e0-a01b-671ae65e3a64', '9957b680-f67f-46d5-a331-cd4742b2c1f8', '95618240-fbf2-404b-b63b-4e520d805e27'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:32:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:32:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:32:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:32:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:32:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.122s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:32:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:32:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 1.075s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:32:35 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:32:36 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Deleted volume successfully.
Sep 10 13:32:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6ca50304-c519-4d68-8a99-ca9a31349d7f tempest-VolumesAdminNegativeTest-14521286 None] Lock "cinder-1024b316-f0dd-44b4-81ed-119b63659a3a-delete_volume" released by "delete_volume" :: held 14.686s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:32:43 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:32:47 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=10,cinder:DELETE=2,cinder:SELECT=3,cinder:INSERT=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:32:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-1f486679-227a-4fa4-a171-bf15a72e700b tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:32:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-1f486679-227a-4fa4-a171-bf15a72e700b tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:32:51 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9bdd6d-3109-43c4-ad9a-68c5ff330a48]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:32:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-1f486679-227a-4fa4-a171-bf15a72e700b tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:32:52 devstack quobyte-client[82845]: System call of process 83909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:32:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-1f486679-227a-4fa4-a171-bf15a72e700b tempest-TaggedBootDevicesTest-158457909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24" returned: 0 in 1.882s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:32:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-1f486679-227a-4fa4-a171-bf15a72e700b tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:32:54 devstack quobyte-client[82845]: System call of process 83915 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:32:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-1f486679-227a-4fa4-a171-bf15a72e700b tempest-TaggedBootDevicesTest-158457909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24" returned: 1 in 1.836s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:32:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-1f486679-227a-4fa4-a171-bf15a72e700b tempest-TaggedBootDevicesTest-158457909 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 13:32:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-1f486679-227a-4fa4-a171-bf15a72e700b tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.152s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:32:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-1f486679-227a-4fa4-a171-bf15a72e700b tempest-TaggedBootDevicesTest-158457909 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-f9f505a3-b855-4799-84de-7e651e8e4e24', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1815eed-b2db-4f54-bfb3-04a05a9772dc', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:32:56 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-1f486679-227a-4fa4-a171-bf15a72e700b tempest-TaggedBootDevicesTest-158457909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:32:56 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-1f486679-227a-4fa4-a171-bf15a72e700b tempest-TaggedBootDevicesTest-158457909 None] attachment_update completed successfully.
Sep 10 13:33:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-51913ad6-8bee-4fbb-aeee-88b6bcd17a31 tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:33:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-51913ad6-8bee-4fbb-aeee-88b6bcd17a31 tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:33:01 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2b2b70-abeb-4589-948b-b92b5e54cd5a]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:33:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-51913ad6-8bee-4fbb-aeee-88b6bcd17a31 tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:33:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-51913ad6-8bee-4fbb-aeee-88b6bcd17a31 tempest-TaggedBootDevicesTest-158457909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a" returned: 0 in 1.320s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:33:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-51913ad6-8bee-4fbb-aeee-88b6bcd17a31 tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.442s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:33:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-51913ad6-8bee-4fbb-aeee-88b6bcd17a31 tempest-TaggedBootDevicesTest-158457909 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2eeed78c-5dca-4517-ab4e-5e023da94e38', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:33:03 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-51913ad6-8bee-4fbb-aeee-88b6bcd17a31 tempest-TaggedBootDevicesTest-158457909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:33:03 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-51913ad6-8bee-4fbb-aeee-88b6bcd17a31 tempest-TaggedBootDevicesTest-158457909 None] attachment_update completed successfully.
Sep 10 13:33:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-8a1b2fee-11ac-47be-93b1-1f525c62ff52 tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:33:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-8a1b2fee-11ac-47be-93b1-1f525c62ff52 tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:33:07 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5aabc25-b639-4c4b-9a63-b7232a525201]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:33:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-8a1b2fee-11ac-47be-93b1-1f525c62ff52 tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-69c51995-af62-42f0-b99c-069d762e1419 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:33:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-8a1b2fee-11ac-47be-93b1-1f525c62ff52 tempest-TaggedBootDevicesTest-158457909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-69c51995-af62-42f0-b99c-069d762e1419" returned: 0 in 1.077s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:33:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-8a1b2fee-11ac-47be-93b1-1f525c62ff52 tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.199s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:33:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-8a1b2fee-11ac-47be-93b1-1f525c62ff52 tempest-TaggedBootDevicesTest-158457909 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-69c51995-af62-42f0-b99c-069d762e1419', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1e64283-bb97-4bf0-bf7f-27ff735ff6b9', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:33:09 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-8a1b2fee-11ac-47be-93b1-1f525c62ff52 tempest-TaggedBootDevicesTest-158457909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:33:10 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-1e64fe55-9878-4005-8b3d-a68bede27399 req-8a1b2fee-11ac-47be-93b1-1f525c62ff52 tempest-TaggedBootDevicesTest-158457909 None] attachment_update completed successfully.
Sep 10 13:33:20 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:33:20 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=17,cinder:UPDATE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:33:27 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:33:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:33:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:33:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:33:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:33:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:33:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:33:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.130s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:33:28 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:33:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-b648b00c-fb8c-4b20-9424-204b8bbea7ce req-ef7efd2d-5c72-403d-8d8b-6c8821324d32 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:33:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-b648b00c-fb8c-4b20-9424-204b8bbea7ce req-ef7efd2d-5c72-403d-8d8b-6c8821324d32 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:33:32 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d97b826-0906-4783-abc5-bfa63bd50406]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:33:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-b648b00c-fb8c-4b20-9424-204b8bbea7ce req-ef7efd2d-5c72-403d-8d8b-6c8821324d32 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-541b1d0b-3799-4bba-91b1-37e025047166 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:33:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-b648b00c-fb8c-4b20-9424-204b8bbea7ce req-ef7efd2d-5c72-403d-8d8b-6c8821324d32 tempest-VolumesAssistedSnapshotsTest-1586795755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-541b1d0b-3799-4bba-91b1-37e025047166" returned: 0 in 0.991s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:33:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-b648b00c-fb8c-4b20-9424-204b8bbea7ce req-ef7efd2d-5c72-403d-8d8b-6c8821324d32 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.107s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:33:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-b648b00c-fb8c-4b20-9424-204b8bbea7ce req-ef7efd2d-5c72-403d-8d8b-6c8821324d32 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-541b1d0b-3799-4bba-91b1-37e025047166', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6235f415-3376-47a3-b604-0fcfaddd04dc', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:33:34 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-b648b00c-fb8c-4b20-9424-204b8bbea7ce req-ef7efd2d-5c72-403d-8d8b-6c8821324d32 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:33:35 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-b648b00c-fb8c-4b20-9424-204b8bbea7ce req-ef7efd2d-5c72-403d-8d8b-6c8821324d32 tempest-VolumesAssistedSnapshotsTest-1586795755 None] attachment_update completed successfully.
Sep 10 13:33:45 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:33:45 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:34:06 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:34:11 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-0a9d417c-d36f-4518-b337-019d56519dc4 req-4edf9837-916c-4d61-93a3-4f937cd332cc tempest-VolumesAssistedSnapshotsTest-1586795755 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:34:12 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-0a9d417c-d36f-4518-b337-019d56519dc4 req-4edf9837-916c-4d61-93a3-4f937cd332cc tempest-VolumesAssistedSnapshotsTest-1586795755 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:34:12 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-0a9d417c-d36f-4518-b337-019d56519dc4 req-4edf9837-916c-4d61-93a3-4f937cd332cc tempest-VolumesAssistedSnapshotsTest-1586795755 None] Terminate volume connection completed successfully.
Sep 10 13:34:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-0a9d417c-d36f-4518-b337-019d56519dc4 req-4edf9837-916c-4d61-93a3-4f937cd332cc tempest-VolumesAssistedSnapshotsTest-1586795755 None] Deleting attachment 6235f415-3376-47a3-b604-0fcfaddd04dc. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:34:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Acquiring lock "cinder-541b1d0b-3799-4bba-91b1-37e025047166-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:34:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Lock "cinder-541b1d0b-3799-4bba-91b1-37e025047166-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:34:15 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:34:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Acquiring lock "cinder-quobyte-541b1d0b-3799-4bba-91b1-37e025047166" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:34:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Lock "cinder-quobyte-541b1d0b-3799-4bba-91b1-37e025047166" acquired by "delete_volume" :: waited 0.052s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:34:15 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5b5a11-f0f5-4167-8dc8-ad6733b2990c]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:34:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-541b1d0b-3799-4bba-91b1-37e025047166 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:34:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-541b1d0b-3799-4bba-91b1-37e025047166" returned: 0 in 1.034s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:34:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-541b1d0b-3799-4bba-91b1-37e025047166 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:34:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-541b1d0b-3799-4bba-91b1-37e025047166" returned: 0 in 0.329s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:34:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Lock "cinder-quobyte-541b1d0b-3799-4bba-91b1-37e025047166" released by "delete_volume" :: held 1.856s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:34:18 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Created reservations ['1b01d7ad-2abb-49b0-9e23-e5af9d65a4dd', '61b67984-2a09-4265-8062-491a9af91fb6', '5f09ccab-cbbc-457a-96d3-3f21ed8f25f6', '2aad1b4e-4d35-454d-ada1-f6d4d8f5e770'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:34:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:34:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:34:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:34:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:34:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:34:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:34:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.264s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:34:19 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:34:19 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Deleted volume successfully.
Sep 10 13:34:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e2b09a74-4654-48c4-af2d-1e7b36d6e723 tempest-VolumesAssistedSnapshotsTest-1586795755 None] Lock "cinder-541b1d0b-3799-4bba-91b1-37e025047166-delete_volume" released by "delete_volume" :: held 5.162s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:34:27 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:34:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:34:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:34:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:34:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:34:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:34:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:34:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.400s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:34:28 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:34:29 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:34:30 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:35:27 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:35:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:35:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:35:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:35:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:35:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.092s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:35:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:35:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.434s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:35:28 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:36:01 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:36:01 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:36:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Flow 'volume_create_manager' (0eaa1c96-6872-4645-80f2-6168242e2780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:36:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034146d5-9aff-4b71-92b5-a70a8483bdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034146d5-9aff-4b71-92b5-a70a8483bdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-909134548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0019bd7b-fd9d-481a-ab17-de0b1189e61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5541f791809b4e91ab5b109543b54fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:01Z,use_quota=True,user_id='df947f11c3a945938c49936961b6ecfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff9a6d3-a505-44d5-abef-25c45a8efbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff9a6d3-a505-44d5-abef-25c45a8efbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18b1d07-0743-4949-88b7-67d22dc0732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d18b1d07-0743-4949-88b7-67d22dc0732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0019bd7b-fd9d-481a-ab17-de0b1189e61b', 'volume_name': 'volume-0019bd7b-fd9d-481a-ab17-de0b1189e61b', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e373274-2d1f-4068-97da-5388d8eecb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e373274-2d1f-4068-97da-5388d8eecb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2795c75a-bc81-48e8-b687-cb9e7f55882d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:36:02 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Volume 0019bd7b-fd9d-481a-ab17-de0b1189e61b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0019bd7b-fd9d-481a-ab17-de0b1189e61b', 'volume_size': 1}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-909134548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0019bd7b-fd9d-481a-ab17-de0b1189e61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5541f791809b4e91ab5b109543b54fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:01Z,use_quota=True,user_id='df947f11c3a945938c49936961b6ecfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Creating volume 0019bd7b-fd9d-481a-ab17-de0b1189e61b {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:36:02 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:36:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0019bd7b-fd9d-481a-ab17-de0b1189e61b 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:36:02 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=7, name=volume-0019bd7b-fd9d-481a-ab17-de0b1189e61b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:36:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0019bd7b-fd9d-481a-ab17-de0b1189e61b 1073741824" returned: 0 in 1.102s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:36:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0019bd7b-fd9d-481a-ab17-de0b1189e61b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:36:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0019bd7b-fd9d-481a-ab17-de0b1189e61b" returned: 0 in 0.161s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:36:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] <== create_volume: return (1396ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:36:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:36:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2795c75a-bc81-48e8-b687-cb9e7f55882d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0019bd7b-fd9d-481a-ab17-de0b1189e61b', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:36:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7022a6be-8cbe-44b6-b579-0f0f8d4b6954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:36:04 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Volume volume-0019bd7b-fd9d-481a-ab17-de0b1189e61b (0019bd7b-fd9d-481a-ab17-de0b1189e61b): created successfully
Sep 10 13:36:04 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7022a6be-8cbe-44b6-b579-0f0f8d4b6954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:36:04 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Flow 'volume_create_manager' (0eaa1c96-6872-4645-80f2-6168242e2780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:36:04 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-784945e7-adbc-4241-b2a4-359504466176 tempest-ServersNegativeTestJSON-1245282001 None] Created volume successfully.
Sep 10 13:36:14 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:36:14 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:36:18 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:36:18 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:36:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Flow 'volume_create_manager' (0244674b-ce61-4bda-b156-ceb870bc0057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:36:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1d7a19-b67b-4518-bf6e-09237bb2cfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1d7a19-b67b-4518-bf6e-09237bb2cfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1575870187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5541f791809b4e91ab5b109543b54fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:19Z,use_quota=True,user_id='df947f11c3a945938c49936961b6ecfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af357621-bd1d-4b5d-8f84-1f7207fd5ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af357621-bd1d-4b5d-8f84-1f7207fd5ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ced6dc-ca94-4ea1-816d-f650df96bf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ced6dc-ca94-4ea1-816d-f650df96bf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde', 'volume_name': 'volume-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef245aa-9e10-4f36-be66-938d09fe3dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef245aa-9e10-4f36-be66-938d09fe3dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b026b38-ce51-47c0-aa8d-dad4c64d12e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:36:19 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Volume adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde', 'volume_size': 1}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1575870187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5541f791809b4e91ab5b109543b54fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:36:19Z,use_quota=True,user_id='df947f11c3a945938c49936961b6ecfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Creating volume adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:36:19 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:36:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:36:19 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=8, name=volume-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:36:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde 1073741824" returned: 0 in 1.097s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:36:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:36:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde" returned: 0 in 1.051s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:36:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] <== create_volume: return (2598ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:36:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.642s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:36:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b026b38-ce51-47c0-aa8d-dad4c64d12e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:36:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6fc0fb6-94b6-44bf-bef2-2553c5ce7a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:36:22 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Volume volume-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde (adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde): created successfully
Sep 10 13:36:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6fc0fb6-94b6-44bf-bef2-2553c5ce7a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:36:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Flow 'volume_create_manager' (0244674b-ce61-4bda-b156-ceb870bc0057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:36:23 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-4d5ec943-73f5-44b5-90b1-ebf7698d37d5 tempest-ServersNegativeTestJSON-1245282001 None] Created volume successfully.
Sep 10 13:36:26 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Acquiring lock "cinder-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:36:26 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Lock "cinder-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:36:27 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:36:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Acquiring lock "cinder-quobyte-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:36:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Lock "cinder-quobyte-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde" acquired by "delete_volume" :: waited 0.018s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:36:27 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a14233-6e67-48c3-bd9f-b503594bbe4b]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:36:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:36:28 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:36:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:36:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:36:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:36:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:36:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:36:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:36:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.448s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:36:28 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:36:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde" returned: 0 in 1.616s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:36:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:36:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde" returned: 0 in 0.185s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:36:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Lock "cinder-quobyte-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde" released by "delete_volume" :: held 2.291s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:36:30 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Created reservations ['82727a3f-ed82-47e5-bdd1-f3aa3b57991f', 'efad77e3-ffec-4919-ac97-666b31cb83bb', 'bc95d55e-ea95-4d6d-88af-b46cf28604fc', 'e89b5157-9211-40f2-b5f1-15835ec577da'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:36:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:36:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:36:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:36:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:36:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:36:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:36:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Acquiring lock "cinder-0019bd7b-fd9d-481a-ab17-de0b1189e61b-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:36:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.472s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:36:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:36:30 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Deleted volume successfully.
Sep 10 13:36:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Lock "cinder-0019bd7b-fd9d-481a-ab17-de0b1189e61b-delete_volume" acquired by "delete_volume" :: waited 0.312s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:36:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c1b650c9-e448-4e67-bb30-3e092afb5ce4 tempest-ServersNegativeTestJSON-1245282001 None] Lock "cinder-adbf9ccf-bda1-46a8-9d8f-0a4d62bcbfde-delete_volume" released by "delete_volume" :: held 4.224s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:36:31 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:36:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Acquiring lock "cinder-quobyte-0019bd7b-fd9d-481a-ab17-de0b1189e61b" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:36:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Lock "cinder-quobyte-0019bd7b-fd9d-481a-ab17-de0b1189e61b" acquired by "delete_volume" :: waited 0.017s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:36:31 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf548a7-d246-4f19-8e35-96a4574ea5ee]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:36:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0019bd7b-fd9d-481a-ab17-de0b1189e61b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:36:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0019bd7b-fd9d-481a-ab17-de0b1189e61b" returned: 0 in 0.685s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:36:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0019bd7b-fd9d-481a-ab17-de0b1189e61b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:36:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0019bd7b-fd9d-481a-ab17-de0b1189e61b" returned: 0 in 0.163s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:36:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Lock "cinder-quobyte-0019bd7b-fd9d-481a-ab17-de0b1189e61b" released by "delete_volume" :: held 1.096s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:36:32 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Created reservations ['821bb9b3-8ac0-4ff5-b923-db3b2e531ea7', '6934ba0f-5d86-4bd1-9934-415cfa4870b0', '34387418-0cb8-4c0a-9263-8333243aae77', 'cf5b5f5b-84d9-4d6f-963e-bc7fadc7c45c'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:36:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:36:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:36:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:36:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:36:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:36:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:36:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.231s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:36:33 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:36:33 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Deleted volume successfully.
Sep 10 13:36:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-163c8ae4-75ab-4261-aea6-e88d74d1cf59 tempest-ServersNegativeTestJSON-1245282001 None] Lock "cinder-0019bd7b-fd9d-481a-ab17-de0b1189e61b-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:36:42 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=21,cinder:SELECT=9,cinder:INSERT=6 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:36:43 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=13,cinder:UPDATE=15,cinder:DELETE=3,cinder:INSERT=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:36:45 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-579fae66-a324-4d15-9e7a-8fb26e7aedcb req-32f2ff61-b6fb-49e9-80dc-a3c3f46f68a6 tempest-TaggedBootDevicesTest-158457909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:36:45 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-579fae66-a324-4d15-9e7a-8fb26e7aedcb req-32f2ff61-b6fb-49e9-80dc-a3c3f46f68a6 tempest-TaggedBootDevicesTest-158457909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:36:45 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-579fae66-a324-4d15-9e7a-8fb26e7aedcb req-32f2ff61-b6fb-49e9-80dc-a3c3f46f68a6 tempest-TaggedBootDevicesTest-158457909 None] Terminate volume connection completed successfully.
Sep 10 13:36:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-579fae66-a324-4d15-9e7a-8fb26e7aedcb req-32f2ff61-b6fb-49e9-80dc-a3c3f46f68a6 tempest-TaggedBootDevicesTest-158457909 None] Deleting attachment b1815eed-b2db-4f54-bfb3-04a05a9772dc. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:36:46 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-579fae66-a324-4d15-9e7a-8fb26e7aedcb req-b2824d72-923c-47aa-9c4d-122420895ae7 tempest-TaggedBootDevicesTest-158457909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:36:46 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-579fae66-a324-4d15-9e7a-8fb26e7aedcb req-b2824d72-923c-47aa-9c4d-122420895ae7 tempest-TaggedBootDevicesTest-158457909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:36:46 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-579fae66-a324-4d15-9e7a-8fb26e7aedcb req-b2824d72-923c-47aa-9c4d-122420895ae7 tempest-TaggedBootDevicesTest-158457909 None] Terminate volume connection completed successfully.
Sep 10 13:36:46 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-579fae66-a324-4d15-9e7a-8fb26e7aedcb req-b2824d72-923c-47aa-9c4d-122420895ae7 tempest-TaggedBootDevicesTest-158457909 None] Deleting attachment 2eeed78c-5dca-4517-ab4e-5e023da94e38. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:36:47 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-579fae66-a324-4d15-9e7a-8fb26e7aedcb req-6fd2224b-e31d-431d-8bbc-504fe8d0e8ba tempest-TaggedBootDevicesTest-158457909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:36:47 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-579fae66-a324-4d15-9e7a-8fb26e7aedcb req-6fd2224b-e31d-431d-8bbc-504fe8d0e8ba tempest-TaggedBootDevicesTest-158457909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:36:47 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-579fae66-a324-4d15-9e7a-8fb26e7aedcb req-6fd2224b-e31d-431d-8bbc-504fe8d0e8ba tempest-TaggedBootDevicesTest-158457909 None] Terminate volume connection completed successfully.
Sep 10 13:36:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-579fae66-a324-4d15-9e7a-8fb26e7aedcb req-6fd2224b-e31d-431d-8bbc-504fe8d0e8ba tempest-TaggedBootDevicesTest-158457909 None] Deleting attachment e1e64283-bb97-4bf0-bf7f-27ff735ff6b9. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:36:57 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:36:57 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=4 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:37:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "cinder-69c51995-af62-42f0-b99c-069d762e1419-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:37:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Lock "cinder-69c51995-af62-42f0-b99c-069d762e1419-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:37:00 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:37:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "cinder-quobyte-69c51995-af62-42f0-b99c-069d762e1419" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:37:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Lock "cinder-quobyte-69c51995-af62-42f0-b99c-069d762e1419" acquired by "delete_volume" :: waited 0.053s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:37:00 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6834fa-6ae1-4939-a2a4-23292a499c7a]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:37:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-69c51995-af62-42f0-b99c-069d762e1419 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-69c51995-af62-42f0-b99c-069d762e1419" returned: 0 in 0.733s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-69c51995-af62-42f0-b99c-069d762e1419 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-69c51995-af62-42f0-b99c-069d762e1419" returned: 0 in 0.255s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Lock "cinder-quobyte-69c51995-af62-42f0-b99c-069d762e1419" released by "delete_volume" :: held 1.463s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:37:02 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Created reservations ['352ba2f5-b35d-418a-b619-2f2f1c288412', 'd162d152-0e12-4ffd-99d0-04f913736a7c', 'caa73ae2-de59-4286-bcb3-d8d93e9978a1', '1b1b4bc5-8746-4d89-84b8-b948e78e4c77'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:37:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:37:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:37:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:37:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:37:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:37:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.238s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:03 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:37:03 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Deleted volume successfully.
Sep 10 13:37:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a4e5b04c-50e5-423f-9e01-0f7fdae278a6 tempest-TaggedBootDevicesTest-158457909 None] Lock "cinder-69c51995-af62-42f0-b99c-069d762e1419-delete_volume" released by "delete_volume" :: held 3.792s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:37:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "cinder-a496adbb-7cc7-4f4b-8646-db5e527cc05a-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:37:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Lock "cinder-a496adbb-7cc7-4f4b-8646-db5e527cc05a-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:37:04 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:37:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "cinder-quobyte-a496adbb-7cc7-4f4b-8646-db5e527cc05a" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:37:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Lock "cinder-quobyte-a496adbb-7cc7-4f4b-8646-db5e527cc05a" acquired by "delete_volume" :: waited 0.041s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:37:04 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa5bdfe-8498-4dc3-8a21-27e803b44bec]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:37:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a" returned: 0 in 0.652s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a496adbb-7cc7-4f4b-8646-db5e527cc05a" returned: 0 in 0.097s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Lock "cinder-quobyte-a496adbb-7cc7-4f4b-8646-db5e527cc05a" released by "delete_volume" :: held 0.939s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:37:06 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Created reservations ['1f9fc8ca-6cbc-4012-930c-2ff13995bf53', '8076f8c9-d0d3-47ff-9226-922f51a3d461', 'f77a5140-c319-4916-af8d-6193689c8cfe', '84d53851-b4db-4b3e-8c17-f4b61c9d0c20'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:37:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:37:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:37:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:37:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:37:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:37:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.132s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:06 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:37:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-553de0c0-24dc-4054-9f33-c793e589fbbd tempest-BackendsCapabilitiesAdminTestsJSON-1633399748 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.910228729248, 'free_capacity_gb': 924.910228729248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82823) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 10 13:37:06 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Deleted volume successfully.
Sep 10 13:37:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-695727ce-87b2-4cda-8563-7109a94c0219 tempest-TaggedBootDevicesTest-158457909 None] Lock "cinder-a496adbb-7cc7-4f4b-8646-db5e527cc05a-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:37:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "cinder-f9f505a3-b855-4799-84de-7e651e8e4e24-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:37:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Lock "cinder-f9f505a3-b855-4799-84de-7e651e8e4e24-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:37:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-aced1117-ba8f-4e78-adbd-5eeee624d7b7 tempest-BackendsCapabilitiesAdminTestsJSON-1633399748 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.910228729248, 'free_capacity_gb': 924.910228729248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82823) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 10 13:37:07 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:37:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "cinder-quobyte-f9f505a3-b855-4799-84de-7e651e8e4e24" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:37:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Lock "cinder-quobyte-f9f505a3-b855-4799-84de-7e651e8e4e24" acquired by "delete_volume" :: waited 0.019s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:37:07 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ababd0d-8d5d-46bb-807a-4b4eca3b9711]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:37:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24" returned: 0 in 0.494s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24" returned: 1 in 0.430s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 13:37:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f9f505a3-b855-4799-84de-7e651e8e4e24" returned: 0 in 0.214s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:08 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Lock "cinder-quobyte-f9f505a3-b855-4799-84de-7e651e8e4e24" released by "delete_volume" :: held 1.454s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:37:09 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Created reservations ['32a9edd1-7751-49c0-a95f-a2aff813ef41', '81d0c88e-241d-4a0e-8b0f-1beb1dfa8040', '90c86d4d-7142-480a-a0a5-6e736bb20bcd', '4f67d08e-3796-4667-8ae3-0fe0ac7faee5'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:37:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:37:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:37:09 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:37:09 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:37:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:37:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.128s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:09 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:37:09 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Deleted volume successfully.
Sep 10 13:37:09 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e1a03e22-c616-4ab2-880c-9db1288889c5 tempest-TaggedBootDevicesTest-158457909 None] Lock "cinder-f9f505a3-b855-4799-84de-7e651e8e4e24-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:37:19 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:37:19 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=23,cinder:SELECT=15,cinder:INSERT=6,cinder:DELETE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:37:27 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:37:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:37:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:37:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:37:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:37:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:37:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.273s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:28 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:37:40 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Flow 'volume_create_manager' (50d88e64-4eae-4de0-848b-409e76925f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0910dff5-cb74-4c1e-8ff3-41365f367192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0910dff5-cb74-4c1e-8ff3-41365f367192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1722992658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de32fd31-262b-4adc-a1ae-cedae840ca3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef4be58155342c1aa8f49322a48928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:37:40Z,use_quota=True,user_id='6153224e153a4570b4848e908427c8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ce0abf-104d-4b2e-b1fb-227dfc12d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ce0abf-104d-4b2e-b1fb-227dfc12d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbcf2ed-3076-4188-9f39-ea5c0db6a776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbcf2ed-3076-4188-9f39-ea5c0db6a776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de32fd31-262b-4adc-a1ae-cedae840ca3d', 'volume_name': 'volume-de32fd31-262b-4adc-a1ae-cedae840ca3d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56c5081-5c6b-4bee-b012-ab0dcd08d6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56c5081-5c6b-4bee-b012-ab0dcd08d6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c35e7621-4d31-4ac2-ba95-19441e11fb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:37:40 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Volume de32fd31-262b-4adc-a1ae-cedae840ca3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de32fd31-262b-4adc-a1ae-cedae840ca3d', 'volume_size': 1}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1722992658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de32fd31-262b-4adc-a1ae-cedae840ca3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ef4be58155342c1aa8f49322a48928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:37:40Z,use_quota=True,user_id='6153224e153a4570b4848e908427c8d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Creating volume de32fd31-262b-4adc-a1ae-cedae840ca3d {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:37:40 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:37:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-de32fd31-262b-4adc-a1ae-cedae840ca3d 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:41 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=9, name=volume-de32fd31-262b-4adc-a1ae-cedae840ca3d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:37:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-de32fd31-262b-4adc-a1ae-cedae840ca3d 1073741824" returned: 0 in 0.777s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-de32fd31-262b-4adc-a1ae-cedae840ca3d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-de32fd31-262b-4adc-a1ae-cedae840ca3d" returned: 0 in 0.131s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] <== create_volume: return (1053ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:37:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:37:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c35e7621-4d31-4ac2-ba95-19441e11fb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de32fd31-262b-4adc-a1ae-cedae840ca3d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:37:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8dce6ca-efb3-45aa-a996-7daeeb913b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:37:42 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Volume volume-de32fd31-262b-4adc-a1ae-cedae840ca3d (de32fd31-262b-4adc-a1ae-cedae840ca3d): created successfully
Sep 10 13:37:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8dce6ca-efb3-45aa-a996-7daeeb913b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:37:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Flow 'volume_create_manager' (50d88e64-4eae-4de0-848b-409e76925f9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:37:42 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-381e2b87-cd5a-42a9-8b83-935d99bfcf8a tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Created volume successfully.
Sep 10 13:37:45 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Acquiring lock "cinder-de32fd31-262b-4adc-a1ae-cedae840ca3d-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:37:45 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Lock "cinder-de32fd31-262b-4adc-a1ae-cedae840ca3d-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:37:45 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:37:45 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Acquiring lock "cinder-quobyte-de32fd31-262b-4adc-a1ae-cedae840ca3d" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:37:45 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Lock "cinder-quobyte-de32fd31-262b-4adc-a1ae-cedae840ca3d" acquired by "delete_volume" :: waited 0.036s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:37:45 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dddc7c-fef2-478f-9e0b-c49531eff081]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:37:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-de32fd31-262b-4adc-a1ae-cedae840ca3d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-de32fd31-262b-4adc-a1ae-cedae840ca3d" returned: 0 in 1.254s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-de32fd31-262b-4adc-a1ae-cedae840ca3d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-de32fd31-262b-4adc-a1ae-cedae840ca3d" returned: 0 in 0.238s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Lock "cinder-quobyte-de32fd31-262b-4adc-a1ae-cedae840ca3d" released by "delete_volume" :: held 1.899s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:37:48 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Created reservations ['fda0fa03-2460-4657-87a9-6e299436fedc', '81d47707-688f-4551-a6e8-8bc20c9a65cb', 'd69954e7-aa23-463a-9845-2a51f2d524e2', '704e3732-51fe-46e9-8f91-12429909d075'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:37:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:37:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:37:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:37:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:37:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:37:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:37:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.188s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:37:48 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:37:48 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Deleted volume successfully.
Sep 10 13:37:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cd2baabb-bef9-4de4-8b3b-5b3f7fa72faf tempest-VolumeQuotasNegativeTestJSON-2110925064 None] Lock "cinder-de32fd31-262b-4adc-a1ae-cedae840ca3d-delete_volume" released by "delete_volume" :: held 3.463s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:38:02 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:38:02 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:38:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Flow 'volume_create_manager' (be7307bf-71e3-4ffa-aab2-a1cb0814abeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:38:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38f1e82-3553-4f02-8c99-d3ddab51b8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:38:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38f1e82-3553-4f02-8c99-d3ddab51b8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1832142555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5940e60-e917-475b-972b-fbbb9748ff2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f51147faa8b4a499528f8db1c968fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:38:03Z,use_quota=True,user_id='30eace60644249d9a9f3cd877bca88c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b03ffe0a-3808-4e56-a339-89d8dddcb505),volume_type_id=b03ffe0a-3808-4e56-a339-89d8dddcb505)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:38:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902c1f46-7ac7-4480-b861-2c5062c36f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:38:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902c1f46-7ac7-4480-b861-2c5062c36f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578ecfe6-9207-48ec-b98d-dc54a4deaad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578ecfe6-9207-48ec-b98d-dc54a4deaad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5940e60-e917-475b-972b-fbbb9748ff2a', 'volume_name': 'volume-d5940e60-e917-475b-972b-fbbb9748ff2a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79e4985-57ae-4600-8094-fdf3a6b9042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79e4985-57ae-4600-8094-fdf3a6b9042a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0d5ee2-2753-4239-84d3-a128a2b319a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:38:03 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Volume d5940e60-e917-475b-972b-fbbb9748ff2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5940e60-e917-475b-972b-fbbb9748ff2a', 'volume_size': 1}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1832142555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5940e60-e917-475b-972b-fbbb9748ff2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f51147faa8b4a499528f8db1c968fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:38:03Z,use_quota=True,user_id='30eace60644249d9a9f3cd877bca88c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b03ffe0a-3808-4e56-a339-89d8dddcb505),volume_type_id=b03ffe0a-3808-4e56-a339-89d8dddcb505)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Creating volume d5940e60-e917-475b-972b-fbbb9748ff2a {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:38:03 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d5940e60-e917-475b-972b-fbbb9748ff2a 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:38:03 devstack quobyte-client[82845]: System call of process 86164 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:38:03 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=10, name=volume-d5940e60-e917-475b-972b-fbbb9748ff2a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d5940e60-e917-475b-972b-fbbb9748ff2a 1073741824" returned: 0 in 0.417s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d5940e60-e917-475b-972b-fbbb9748ff2a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d5940e60-e917-475b-972b-fbbb9748ff2a" returned: 0 in 0.184s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] <== create_volume: return (706ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:38:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:38:04 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0d5ee2-2753-4239-84d3-a128a2b319a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5940e60-e917-475b-972b-fbbb9748ff2a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:38:04 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b340d8b-dcbb-4dca-81e9-bf2032adfb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:38:04 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Volume volume-d5940e60-e917-475b-972b-fbbb9748ff2a (d5940e60-e917-475b-972b-fbbb9748ff2a): created successfully
Sep 10 13:38:04 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b340d8b-dcbb-4dca-81e9-bf2032adfb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:38:04 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Flow 'volume_create_manager' (be7307bf-71e3-4ffa-aab2-a1cb0814abeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:38:04 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-cff178a2-3040-4a59-b2db-af18d0d05d6f tempest-VolumeTypesAccessTest-1460621516 None] Created volume successfully.
Sep 10 13:38:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Acquiring lock "cinder-d5940e60-e917-475b-972b-fbbb9748ff2a-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:38:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Lock "cinder-d5940e60-e917-475b-972b-fbbb9748ff2a-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:38:05 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:38:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Acquiring lock "cinder-quobyte-d5940e60-e917-475b-972b-fbbb9748ff2a" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:38:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Lock "cinder-quobyte-d5940e60-e917-475b-972b-fbbb9748ff2a" acquired by "delete_volume" :: waited 0.021s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:38:05 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[149667db-cf44-4999-bc10-fe7d2bfe0b43]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:38:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d5940e60-e917-475b-972b-fbbb9748ff2a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:38:06 devstack quobyte-client[82845]: System call of process 86168 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:38:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d5940e60-e917-475b-972b-fbbb9748ff2a" returned: 0 in 0.557s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:38:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d5940e60-e917-475b-972b-fbbb9748ff2a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:38:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d5940e60-e917-475b-972b-fbbb9748ff2a" returned: 0 in 0.161s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:38:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Lock "cinder-quobyte-d5940e60-e917-475b-972b-fbbb9748ff2a" released by "delete_volume" :: held 1.098s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:38:06 devstack cinder-volume[82823]: WARNING cinder.quota [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1113214853 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1113214853, it is now deprecated. Please use the default quota class for default quota.
Sep 10 13:38:06 devstack cinder-volume[82823]: WARNING cinder.quota [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1113214853 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1113214853, it is now deprecated. Please use the default quota class for default quota.
Sep 10 13:38:07 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Created reservations ['831e20e0-4257-43dd-a955-63067f1fb3a0', '0342dc49-8eab-4a08-b852-1c46ebda008d', '41b6b98e-9ce9-4ec0-8d7a-23853d648880', '99dc8aca-eb13-4a3a-a1ed-816e150b8df7'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:38:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:38:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:38:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:38:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:38:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:38:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:38:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.101s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:38:07 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:38:07 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Deleted volume successfully.
Sep 10 13:38:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-fd27d475-2bdc-493e-9259-e8d2479a548b tempest-VolumeTypesAccessTest-1460621516 None] Lock "cinder-d5940e60-e917-475b-972b-fbbb9748ff2a-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:38:17 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=21,cinder:SELECT=12,cinder:INSERT=5,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:38:17 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=13,cinder:UPDATE=20,cinder:DELETE=3,cinder:INSERT=3 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:38:27 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:38:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:38:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.051s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:38:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:38:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:38:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.113s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:38:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:38:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 1.138s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:38:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:38:39 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Flow 'volume_create_manager' (0def921f-0da0-4fa0-928f-c2d4bdce7523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047785d9-2bc0-4f2e-bb89-c99299e11a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047785d9-2bc0-4f2e-bb89-c99299e11a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1739704822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba7c75a-bec0-4b65-a5b4-c637b16957ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29458dfc6e944b4873c1313cd32b8b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:38:39Z,use_quota=True,user_id='95dc9f6fffde4de0a7ebd52e73b5f096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda49e69-a28b-4311-97c0-0c6739da2104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda49e69-a28b-4311-97c0-0c6739da2104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d33574-61a9-4f53-b28c-dfa464ac2417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d33574-61a9-4f53-b28c-dfa464ac2417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ba7c75a-bec0-4b65-a5b4-c637b16957ee', 'volume_name': 'volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0e2654-060b-4a19-8271-dfa8c3827e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0e2654-060b-4a19-8271-dfa8c3827e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be936cea-f844-46e7-b75d-1ea53044c3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:38:39 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Volume 1ba7c75a-bec0-4b65-a5b4-c637b16957ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee', 'volume_size': 1}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1739704822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba7c75a-bec0-4b65-a5b4-c637b16957ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29458dfc6e944b4873c1313cd32b8b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:38:39Z,use_quota=True,user_id='95dc9f6fffde4de0a7ebd52e73b5f096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Creating volume 1ba7c75a-bec0-4b65-a5b4-c637b16957ee {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:38:39 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:38:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:38:40 devstack quobyte-client[82845]: System call of process 86325 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:38:40 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=11, name=volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:38:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee 1073741824" returned: 0 in 0.785s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:38:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:38:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee" returned: 0 in 0.154s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:38:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] <== create_volume: return (1112ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:38:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:38:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be936cea-f844-46e7-b75d-1ea53044c3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:38:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd361862-8118-4daf-b085-c2a11a75ea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:38:41 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Volume volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee (1ba7c75a-bec0-4b65-a5b4-c637b16957ee): created successfully
Sep 10 13:38:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd361862-8118-4daf-b085-c2a11a75ea85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:38:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Flow 'volume_create_manager' (0def921f-0da0-4fa0-928f-c2d4bdce7523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:38:41 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-de972735-5fa2-44c3-a8cd-202dfc2254db tempest-AttachSCSIVolumeTestJSON-1501825960 None] Created volume successfully.
Sep 10 13:38:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-50c6e985-7e04-4035-987c-4ad51423d714 req-acd1c583-a4e4-45fb-bc00-b3b0e3a5d7cc tempest-AttachSCSIVolumeTestJSON-1501825960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:38:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-50c6e985-7e04-4035-987c-4ad51423d714 req-acd1c583-a4e4-45fb-bc00-b3b0e3a5d7cc tempest-AttachSCSIVolumeTestJSON-1501825960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:38:46 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccab6e3-78f1-4282-babd-278db4dd995c]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:38:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-50c6e985-7e04-4035-987c-4ad51423d714 req-acd1c583-a4e4-45fb-bc00-b3b0e3a5d7cc tempest-AttachSCSIVolumeTestJSON-1501825960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:38:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-50c6e985-7e04-4035-987c-4ad51423d714 req-acd1c583-a4e4-45fb-bc00-b3b0e3a5d7cc tempest-AttachSCSIVolumeTestJSON-1501825960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee" returned: 0 in 0.742s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:38:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-50c6e985-7e04-4035-987c-4ad51423d714 req-acd1c583-a4e4-45fb-bc00-b3b0e3a5d7cc tempest-AttachSCSIVolumeTestJSON-1501825960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.814s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:38:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-50c6e985-7e04-4035-987c-4ad51423d714 req-acd1c583-a4e4-45fb-bc00-b3b0e3a5d7cc tempest-AttachSCSIVolumeTestJSON-1501825960 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '204126f1-4824-4d4b-b636-9425cb31a523', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:38:47 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-50c6e985-7e04-4035-987c-4ad51423d714 req-acd1c583-a4e4-45fb-bc00-b3b0e3a5d7cc tempest-AttachSCSIVolumeTestJSON-1501825960 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:38:48 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-50c6e985-7e04-4035-987c-4ad51423d714 req-acd1c583-a4e4-45fb-bc00-b3b0e3a5d7cc tempest-AttachSCSIVolumeTestJSON-1501825960 None] attachment_update completed successfully.
Sep 10 13:38:58 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:38:58 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:39:19 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-8a94b916-3b17-477c-9038-32044fe7f085 req-b7d3fc03-73e8-4cf3-a9bf-6e7d526554e7 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:39:19 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-8a94b916-3b17-477c-9038-32044fe7f085 req-b7d3fc03-73e8-4cf3-a9bf-6e7d526554e7 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:39:19 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-8a94b916-3b17-477c-9038-32044fe7f085 req-b7d3fc03-73e8-4cf3-a9bf-6e7d526554e7 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Terminate volume connection completed successfully.
Sep 10 13:39:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8a94b916-3b17-477c-9038-32044fe7f085 req-b7d3fc03-73e8-4cf3-a9bf-6e7d526554e7 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Deleting attachment 204126f1-4824-4d4b-b636-9425cb31a523. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:39:27 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:39:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:39:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:39:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:39:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:39:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:39:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:39:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.409s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:39:28 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:39:29 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:39:29 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:39:45 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Acquiring lock "cinder-1ba7c75a-bec0-4b65-a5b4-c637b16957ee-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:39:45 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Lock "cinder-1ba7c75a-bec0-4b65-a5b4-c637b16957ee-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:39:46 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:39:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Acquiring lock "cinder-quobyte-1ba7c75a-bec0-4b65-a5b4-c637b16957ee" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:39:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Lock "cinder-quobyte-1ba7c75a-bec0-4b65-a5b4-c637b16957ee" acquired by "delete_volume" :: waited 0.029s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:39:46 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dc8a0b-8d51-4753-a055-d1fdd6fe930f]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:39:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:39:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee" returned: 0 in 1.177s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:39:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:39:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1ba7c75a-bec0-4b65-a5b4-c637b16957ee" returned: 0 in 0.205s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Lock "cinder-quobyte-1ba7c75a-bec0-4b65-a5b4-c637b16957ee" released by "delete_volume" :: held 1.815s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:39:48 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Flow 'volume_create_manager' (7e77cccc-99e9-46f2-b09d-90f60a856893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0b26b1-1cf8-43fd-bce4-920fec8e3b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0b26b1-1cf8-43fd-bce4-920fec8e3b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-215558114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3667987a-6852-4b90-93a9-7882389ff584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42cf01748de843fdb809b5c0870dd0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:39:48Z,use_quota=True,user_id='b1347bbd92ca44bf91859cb80c1238b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0915ff8-fb9a-4b54-8b6a-9e6dbcf14c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0915ff8-fb9a-4b54-8b6a-9e6dbcf14c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483e1e9f-78ae-4f2a-ae6f-f36e91ed6605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483e1e9f-78ae-4f2a-ae6f-f36e91ed6605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3667987a-6852-4b90-93a9-7882389ff584', 'volume_name': 'volume-3667987a-6852-4b90-93a9-7882389ff584', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e2e2fc-a1df-44eb-bf0f-e6efdf6a8ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e2e2fc-a1df-44eb-bf0f-e6efdf6a8ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab60bb47-4e6b-4a98-819e-d4bc852ba2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:39:48 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Volume 3667987a-6852-4b90-93a9-7882389ff584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3667987a-6852-4b90-93a9-7882389ff584', 'volume_size': 1}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-215558114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3667987a-6852-4b90-93a9-7882389ff584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42cf01748de843fdb809b5c0870dd0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:39:48Z,use_quota=True,user_id='b1347bbd92ca44bf91859cb80c1238b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Creating volume 3667987a-6852-4b90-93a9-7882389ff584 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:39:48 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:39:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3667987a-6852-4b90-93a9-7882389ff584 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:39:48 devstack quobyte-client[82845]: System call of process 87038 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:39:48 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=12, name=volume-3667987a-6852-4b90-93a9-7882389ff584, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3667987a-6852-4b90-93a9-7882389ff584 1073741824" returned: 0 in 0.596s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3667987a-6852-4b90-93a9-7882389ff584 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Created reservations ['e54d104f-cbcb-4e4c-9635-091d2c329057', 'f36d4b2c-102f-4578-a96f-9abec302ed71', '0cea996b-9325-44ac-a41c-d524de096056', '4177342f-0149-4aae-978a-6ba10fd9416d'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3667987a-6852-4b90-93a9-7882389ff584" returned: 0 in 0.337s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] <== create_volume: return (986ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab60bb47-4e6b-4a98-819e-d4bc852ba2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3667987a-6852-4b90-93a9-7882389ff584', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a852011d-afc3-4889-bfd5-fac36be23e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:39:49 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Volume volume-3667987a-6852-4b90-93a9-7882389ff584 (3667987a-6852-4b90-93a9-7882389ff584): created successfully
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a852011d-afc3-4889-bfd5-fac36be23e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Flow 'volume_create_manager' (7e77cccc-99e9-46f2-b09d-90f60a856893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:39:49 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-cccc4ad9-3a67-4f3a-ba3d-ed840a048923 tempest-AttachVolumeTestJSON-1032577895 None] Created volume successfully.
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.182s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:39:49 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:39:50 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Deleted volume successfully.
Sep 10 13:39:50 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-50097515-a575-4adb-a708-c15722a70fc5 tempest-AttachSCSIVolumeTestJSON-1501825960 None] Lock "cinder-1ba7c75a-bec0-4b65-a5b4-c637b16957ee-delete_volume" released by "delete_volume" :: held 4.294s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:39:51 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Flow 'volume_create_manager' (54be57f6-20dd-4514-9eaa-9ef7e48e8c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf7a421-169d-4a15-98ce-889751536bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf7a421-169d-4a15-98ce-889751536bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-367800509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ede5fe7-1cde-4a99-9539-321c3292ae77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634fda2a7e1c4624b96275327b2fcdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:39:51Z,use_quota=True,user_id='a34dc46865944985b131077a5d69ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b92f65-3d80-4d07-ab63-0ba3312607c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b92f65-3d80-4d07-ab63-0ba3312607c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead20826-e777-404e-b9cc-2955eb0ea6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead20826-e777-404e-b9cc-2955eb0ea6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ede5fe7-1cde-4a99-9539-321c3292ae77', 'volume_name': 'volume-9ede5fe7-1cde-4a99-9539-321c3292ae77', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ab554c-8f19-4b16-a742-65798d66ebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ab554c-8f19-4b16-a742-65798d66ebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2ddc25-cbfc-434d-a4ee-41ff171aa5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:39:51 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Volume 9ede5fe7-1cde-4a99-9539-321c3292ae77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ede5fe7-1cde-4a99-9539-321c3292ae77', 'volume_size': 1}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-367800509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ede5fe7-1cde-4a99-9539-321c3292ae77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634fda2a7e1c4624b96275327b2fcdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:39:51Z,use_quota=True,user_id='a34dc46865944985b131077a5d69ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Creating volume 9ede5fe7-1cde-4a99-9539-321c3292ae77 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:39:51 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:39:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-9ede5fe7-1cde-4a99-9539-321c3292ae77 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:39:52 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=13, name=volume-9ede5fe7-1cde-4a99-9539-321c3292ae77, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:39:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-9ede5fe7-1cde-4a99-9539-321c3292ae77 1073741824" returned: 0 in 0.624s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:39:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-9ede5fe7-1cde-4a99-9539-321c3292ae77 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:39:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-9ede5fe7-1cde-4a99-9539-321c3292ae77" returned: 0 in 0.198s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:39:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] <== create_volume: return (973ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:39:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:39:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2ddc25-cbfc-434d-a4ee-41ff171aa5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ede5fe7-1cde-4a99-9539-321c3292ae77', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:39:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72940f2-23fa-453e-b8c4-e3520037957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:39:53 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Volume volume-9ede5fe7-1cde-4a99-9539-321c3292ae77 (9ede5fe7-1cde-4a99-9539-321c3292ae77): created successfully
Sep 10 13:39:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72940f2-23fa-453e-b8c4-e3520037957a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:39:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Flow 'volume_create_manager' (54be57f6-20dd-4514-9eaa-9ef7e48e8c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:39:53 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-af3c5370-deb4-4407-a1f1-8bcb9c44c60b tempest-VolumesActionsTest-732193090 None] Created volume successfully.
Sep 10 13:39:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-5e1af991-4275-41f0-9c0b-bf6620d696b5 tempest-VolumesActionsTest-732193090 None] Acquiring lock "cinder-9ede5fe7-1cde-4a99-9539-321c3292ae77" by "attach_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:39:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-5e1af991-4275-41f0-9c0b-bf6620d696b5 tempest-VolumesActionsTest-732193090 None] Lock "cinder-9ede5fe7-1cde-4a99-9539-321c3292ae77" acquired by "attach_volume" :: waited 0.112s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:39:54 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-5e1af991-4275-41f0-9c0b-bf6620d696b5 tempest-VolumesActionsTest-732193090 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:39:54 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-5e1af991-4275-41f0-9c0b-bf6620d696b5 tempest-VolumesActionsTest-732193090 None] Attaching volume 9ede5fe7-1cde-4a99-9539-321c3292ae77 to instance 1c2124b0-c0e5-46dd-8abf-710db43e3c44 at mountpoint /dev/vdb on host None.
Sep 10 13:39:54 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-5e1af991-4275-41f0-9c0b-bf6620d696b5 tempest-VolumesActionsTest-732193090 None] Attach volume completed successfully.
Sep 10 13:39:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-5e1af991-4275-41f0-9c0b-bf6620d696b5 tempest-VolumesActionsTest-732193090 None] Lock "cinder-9ede5fe7-1cde-4a99-9539-321c3292ae77" released by "attach_volume" :: held 0.820s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:39:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-e654f05f-2e6b-4e03-9a3d-3c75907de7c8 req-df2c7978-9902-482d-b4ae-4703e96584e0 tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:39:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-e654f05f-2e6b-4e03-9a3d-3c75907de7c8 req-df2c7978-9902-482d-b4ae-4703e96584e0 tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:39:55 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[5016b10a-d62c-4a9d-bec5-7a9998d24b18]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:39:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-e654f05f-2e6b-4e03-9a3d-3c75907de7c8 req-df2c7978-9902-482d-b4ae-4703e96584e0 tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3667987a-6852-4b90-93a9-7882389ff584 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:39:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-e654f05f-2e6b-4e03-9a3d-3c75907de7c8 req-df2c7978-9902-482d-b4ae-4703e96584e0 tempest-AttachVolumeTestJSON-1032577895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3667987a-6852-4b90-93a9-7882389ff584" returned: 0 in 0.685s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:39:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-e654f05f-2e6b-4e03-9a3d-3c75907de7c8 req-df2c7978-9902-482d-b4ae-4703e96584e0 tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.775s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:39:56 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b410e061-7c4d-492d-b3ba-e5027c6c831f tempest-VolumesActionsTest-1151728191 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:39:56 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b410e061-7c4d-492d-b3ba-e5027c6c831f tempest-VolumesActionsTest-1151728191 None] Terminate volume connection completed successfully.
Sep 10 13:39:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-e654f05f-2e6b-4e03-9a3d-3c75907de7c8 req-df2c7978-9902-482d-b4ae-4703e96584e0 tempest-AttachVolumeTestJSON-1032577895 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-3667987a-6852-4b90-93a9-7882389ff584', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1be02038-ca3e-40f6-82c5-d311ea15fbcc', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:39:56 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-e654f05f-2e6b-4e03-9a3d-3c75907de7c8 req-df2c7978-9902-482d-b4ae-4703e96584e0 tempest-AttachVolumeTestJSON-1032577895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:39:56 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-e654f05f-2e6b-4e03-9a3d-3c75907de7c8 req-df2c7978-9902-482d-b4ae-4703e96584e0 tempest-AttachVolumeTestJSON-1032577895 None] attachment_update completed successfully.
Sep 10 13:39:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b410e061-7c4d-492d-b3ba-e5027c6c831f tempest-VolumesActionsTest-1151728191 None] Acquiring lock "cinder-9ede5fe7-1cde-4a99-9539-321c3292ae77-detach_volume" by "detach_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:39:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b410e061-7c4d-492d-b3ba-e5027c6c831f tempest-VolumesActionsTest-1151728191 None] Lock "cinder-9ede5fe7-1cde-4a99-9539-321c3292ae77-detach_volume" acquired by "detach_volume" :: waited 0.129s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:39:57 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b410e061-7c4d-492d-b3ba-e5027c6c831f tempest-VolumesActionsTest-1151728191 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:39:57 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b410e061-7c4d-492d-b3ba-e5027c6c831f tempest-VolumesActionsTest-1151728191 None] Detaching volume 9ede5fe7-1cde-4a99-9539-321c3292ae77 from instance 1c2124b0-c0e5-46dd-8abf-710db43e3c44.
Sep 10 13:39:57 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b410e061-7c4d-492d-b3ba-e5027c6c831f tempest-VolumesActionsTest-1151728191 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:39:57 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b410e061-7c4d-492d-b3ba-e5027c6c831f tempest-VolumesActionsTest-1151728191 None] Detach volume completed successfully.
Sep 10 13:39:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b410e061-7c4d-492d-b3ba-e5027c6c831f tempest-VolumesActionsTest-1151728191 None] Lock "cinder-9ede5fe7-1cde-4a99-9539-321c3292ae77-detach_volume" released by "detach_volume" :: held 0.191s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:39:58 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1a929ebb-2848-41fd-8844-68171fc7cb2c tempest-VolumesActionsTest-732193090 None] Acquiring lock "cinder-9ede5fe7-1cde-4a99-9539-321c3292ae77-detach_volume" by "detach_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:39:58 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1a929ebb-2848-41fd-8844-68171fc7cb2c tempest-VolumesActionsTest-732193090 None] Lock "cinder-9ede5fe7-1cde-4a99-9539-321c3292ae77-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:39:58 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-1a929ebb-2848-41fd-8844-68171fc7cb2c tempest-VolumesActionsTest-732193090 None] Volume detach called, but volume not attached.
Sep 10 13:39:58 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1a929ebb-2848-41fd-8844-68171fc7cb2c tempest-VolumesActionsTest-732193090 None] Lock "cinder-9ede5fe7-1cde-4a99-9539-321c3292ae77-detach_volume" released by "detach_volume" :: held 0.048s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:39:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Acquiring lock "cinder-9ede5fe7-1cde-4a99-9539-321c3292ae77-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:39:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Lock "cinder-9ede5fe7-1cde-4a99-9539-321c3292ae77-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:40:00 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:40:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Acquiring lock "cinder-quobyte-9ede5fe7-1cde-4a99-9539-321c3292ae77" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:40:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Lock "cinder-quobyte-9ede5fe7-1cde-4a99-9539-321c3292ae77" acquired by "delete_volume" :: waited 0.014s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:40:00 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[9223a3ea-cad6-49c5-939d-5e9a105a1242]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:40:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-9ede5fe7-1cde-4a99-9539-321c3292ae77 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:01 devstack quobyte-client[82845]: System call of process 87446 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:40:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-9ede5fe7-1cde-4a99-9539-321c3292ae77" returned: 0 in 1.078s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-9ede5fe7-1cde-4a99-9539-321c3292ae77 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-9ede5fe7-1cde-4a99-9539-321c3292ae77" returned: 0 in 0.143s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Lock "cinder-quobyte-9ede5fe7-1cde-4a99-9539-321c3292ae77" released by "delete_volume" :: held 1.484s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:40:02 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Created reservations ['d36fc019-3c2a-44c4-a9ef-a5243b2dba69', 'a72a14dc-e5d5-4e85-b801-52cf1df60250', '95b047b2-d001-4679-bad9-8c1ab86e88b6', '2b7a393b-8793-4ccd-903e-8615705de2ab'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:40:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:40:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:40:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.140s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:02 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:40:02 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Deleted volume successfully.
Sep 10 13:40:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-9350d98c-9967-4cff-9d77-43d0baa7bc4e tempest-VolumesActionsTest-732193090 None] Lock "cinder-9ede5fe7-1cde-4a99-9539-321c3292ae77-delete_volume" released by "delete_volume" :: held 3.405s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:40:12 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=28,cinder:UPDATE=19,cinder:INSERT=9,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:40:13 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=23,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:40:14 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:40:14 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Flow 'volume_create_manager' (67e5ce5b-38db-433b-9f2b-8eeaebfa142e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b91fab7-0809-4c46-a541-74c5c9db3db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b91fab7-0809-4c46-a541-74c5c9db3db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2090977881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f58faf-d5c0-4713-8830-9181121dabfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634fda2a7e1c4624b96275327b2fcdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:15Z,use_quota=True,user_id='a34dc46865944985b131077a5d69ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d26db63-1914-413c-b612-e5545abb1dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d26db63-1914-413c-b612-e5545abb1dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935ae0ca-72bc-4274-9579-cb5585de7f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935ae0ca-72bc-4274-9579-cb5585de7f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f58faf-d5c0-4713-8830-9181121dabfe', 'volume_name': 'volume-80f58faf-d5c0-4713-8830-9181121dabfe', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc8b463-edc1-44e1-8a8c-301c00f34308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc8b463-edc1-44e1-8a8c-301c00f34308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725ad0cf-25c4-4e31-be46-4bcbc98c92f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:15 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Volume 80f58faf-d5c0-4713-8830-9181121dabfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f58faf-d5c0-4713-8830-9181121dabfe', 'volume_size': 1}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2090977881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f58faf-d5c0-4713-8830-9181121dabfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634fda2a7e1c4624b96275327b2fcdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:15Z,use_quota=True,user_id='a34dc46865944985b131077a5d69ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Creating volume 80f58faf-d5c0-4713-8830-9181121dabfe {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:40:15 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-80f58faf-d5c0-4713-8830-9181121dabfe 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:15 devstack quobyte-client[82845]: System call of process 87537 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:40:15 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=14, name=volume-80f58faf-d5c0-4713-8830-9181121dabfe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-80f58faf-d5c0-4713-8830-9181121dabfe 1073741824" returned: 0 in 0.422s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-80f58faf-d5c0-4713-8830-9181121dabfe {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-80f58faf-d5c0-4713-8830-9181121dabfe" returned: 0 in 0.136s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] <== create_volume: return (637ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:40:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.648s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725ad0cf-25c4-4e31-be46-4bcbc98c92f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f58faf-d5c0-4713-8830-9181121dabfe', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3674c050-4488-46c9-8552-3b1a10b49707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:16 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Volume volume-80f58faf-d5c0-4713-8830-9181121dabfe (80f58faf-d5c0-4713-8830-9181121dabfe): created successfully
Sep 10 13:40:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3674c050-4488-46c9-8552-3b1a10b49707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Flow 'volume_create_manager' (67e5ce5b-38db-433b-9f2b-8eeaebfa142e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:40:16 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b5e5fc68-9257-4c1f-9226-94b8a86983c0 tempest-VolumesActionsTest-732193090 None] Created volume successfully.
Sep 10 13:40:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Acquiring lock "cinder-80f58faf-d5c0-4713-8830-9181121dabfe-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:40:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Lock "cinder-80f58faf-d5c0-4713-8830-9181121dabfe-delete_volume" acquired by "delete_volume" :: waited 0.158s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:40:18 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:40:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Acquiring lock "cinder-quobyte-80f58faf-d5c0-4713-8830-9181121dabfe" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:40:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Lock "cinder-quobyte-80f58faf-d5c0-4713-8830-9181121dabfe" acquired by "delete_volume" :: waited 0.028s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:40:18 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf3d96e-1d9d-46a6-945c-c7389c3bf51c]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:40:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-80f58faf-d5c0-4713-8830-9181121dabfe {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-80f58faf-d5c0-4713-8830-9181121dabfe" returned: 0 in 0.563s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-80f58faf-d5c0-4713-8830-9181121dabfe {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-80f58faf-d5c0-4713-8830-9181121dabfe" returned: 0 in 0.115s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:19 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Lock "cinder-quobyte-80f58faf-d5c0-4713-8830-9181121dabfe" released by "delete_volume" :: held 0.911s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:40:19 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Created reservations ['97d43f07-014a-4ef5-83f4-263f78e9e07d', '64d70759-75b4-46c1-a6a0-0a929b5747b4', '9c800e84-f6ae-49ae-9b58-f405e92faa71', '9885f6f4-b1c3-4ba9-8e03-03950c8b9bf3'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:40:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:40:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:40:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.223s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:20 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:40:20 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Deleted volume successfully.
Sep 10 13:40:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e04ecf27-1f6b-495c-90b1-05c72a8dc50d tempest-VolumesActionsTest-1151728191 None] Lock "cinder-80f58faf-d5c0-4713-8830-9181121dabfe-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:40:21 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:40:21 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:40:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Flow 'volume_create_manager' (fbe99ad5-a806-4ef5-8545-cead82893132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:40:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa67d18-73dc-4a24-9372-af3ebd2b6677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa67d18-73dc-4a24-9372-af3ebd2b6677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1092490455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f616a7a-a056-498c-bca8-0283e8a21902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634fda2a7e1c4624b96275327b2fcdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:21Z,use_quota=True,user_id='a34dc46865944985b131077a5d69ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83f528e-c1ac-426f-8635-a8300afa213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83f528e-c1ac-426f-8635-a8300afa213d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8b68d0-0a17-4e2a-8f8e-a72fea361454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8b68d0-0a17-4e2a-8f8e-a72fea361454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f616a7a-a056-498c-bca8-0283e8a21902', 'volume_name': 'volume-8f616a7a-a056-498c-bca8-0283e8a21902', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a668b2-03b9-441f-847d-7112a16aba0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a668b2-03b9-441f-847d-7112a16aba0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b8404c-af04-4bb5-ac46-8965cae9c81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:22 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Volume 8f616a7a-a056-498c-bca8-0283e8a21902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f616a7a-a056-498c-bca8-0283e8a21902', 'volume_size': 1}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1092490455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f616a7a-a056-498c-bca8-0283e8a21902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634fda2a7e1c4624b96275327b2fcdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:21Z,use_quota=True,user_id='a34dc46865944985b131077a5d69ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Creating volume 8f616a7a-a056-498c-bca8-0283e8a21902 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:40:22 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:40:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8f616a7a-a056-498c-bca8-0283e8a21902 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:22 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=15, name=volume-8f616a7a-a056-498c-bca8-0283e8a21902, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:40:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8f616a7a-a056-498c-bca8-0283e8a21902 1073741824" returned: 0 in 0.723s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8f616a7a-a056-498c-bca8-0283e8a21902 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8f616a7a-a056-498c-bca8-0283e8a21902" returned: 0 in 0.224s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] <== create_volume: return (1147ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:40:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b8404c-af04-4bb5-ac46-8965cae9c81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f616a7a-a056-498c-bca8-0283e8a21902', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfb647c-ca55-4cc5-88ea-8c9ea147eddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:24 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Volume volume-8f616a7a-a056-498c-bca8-0283e8a21902 (8f616a7a-a056-498c-bca8-0283e8a21902): created successfully
Sep 10 13:40:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfb647c-ca55-4cc5-88ea-8c9ea147eddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Flow 'volume_create_manager' (fbe99ad5-a806-4ef5-8545-cead82893132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:40:24 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-c4e7ff36-5c8d-49bd-9136-bf5072a82d8c tempest-VolumesActionsTest-732193090 None] Created volume successfully.
Sep 10 13:40:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Acquiring lock "cinder-8f616a7a-a056-498c-bca8-0283e8a21902-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:40:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Lock "cinder-8f616a7a-a056-498c-bca8-0283e8a21902-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:40:25 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:40:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Acquiring lock "cinder-quobyte-8f616a7a-a056-498c-bca8-0283e8a21902" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:40:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Lock "cinder-quobyte-8f616a7a-a056-498c-bca8-0283e8a21902" acquired by "delete_volume" :: waited 0.016s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:40:25 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8061afd-f820-4230-9583-39c4a1c2152a]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:40:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8f616a7a-a056-498c-bca8-0283e8a21902 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:26 devstack quobyte-client[82845]: System call of process 87984 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:40:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8f616a7a-a056-498c-bca8-0283e8a21902" returned: 0 in 0.758s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8f616a7a-a056-498c-bca8-0283e8a21902 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8f616a7a-a056-498c-bca8-0283e8a21902" returned: 0 in 0.198s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Lock "cinder-quobyte-8f616a7a-a056-498c-bca8-0283e8a21902" released by "delete_volume" :: held 1.367s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:40:27 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Created reservations ['96d0ef1c-e326-434d-94f2-ba89d7825768', '81a1bab1-0e60-4a19-abf4-85da0a58dc2b', '402e16d6-36db-4d4d-be4f-34fbdf750e32', '6ef9dff0-b7d2-4639-8036-3e91dfc7f725'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:40:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:40:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:40:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.220s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:28 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:40:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:40:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:40:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:28 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:40:28 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Deleted volume successfully.
Sep 10 13:40:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.944s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:40:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3004ef4e-21ed-4e8b-8955-38f56b5367b7 tempest-VolumesActionsTest-1151728191 None] Lock "cinder-8f616a7a-a056-498c-bca8-0283e8a21902-delete_volume" released by "delete_volume" :: held 3.979s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:40:29 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:40:29 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:40:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Flow 'volume_create_manager' (a59a6624-2b72-4a28-8da3-0261ebd8f10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:40:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae6dbd1-e94f-40b2-b3df-65b2ffcadd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae6dbd1-e94f-40b2-b3df-65b2ffcadd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-630945240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa0e98e-03d2-49ef-871b-19b2fe29181c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634fda2a7e1c4624b96275327b2fcdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:29Z,use_quota=True,user_id='a34dc46865944985b131077a5d69ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac51e021-a042-42d6-989c-dbab6db29daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac51e021-a042-42d6-989c-dbab6db29daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35779de8-bdf2-4c08-a451-f292fea9b2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35779de8-bdf2-4c08-a451-f292fea9b2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fa0e98e-03d2-49ef-871b-19b2fe29181c', 'volume_name': 'volume-1fa0e98e-03d2-49ef-871b-19b2fe29181c', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62b244f-079e-4f2b-8667-0aca3a3eaaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62b244f-079e-4f2b-8667-0aca3a3eaaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1567b4e-460e-4e9a-aa15-fca141cb7a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:30 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Volume 1fa0e98e-03d2-49ef-871b-19b2fe29181c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fa0e98e-03d2-49ef-871b-19b2fe29181c', 'volume_size': 1}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-630945240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa0e98e-03d2-49ef-871b-19b2fe29181c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634fda2a7e1c4624b96275327b2fcdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:29Z,use_quota=True,user_id='a34dc46865944985b131077a5d69ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Creating volume 1fa0e98e-03d2-49ef-871b-19b2fe29181c {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:40:30 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:40:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1fa0e98e-03d2-49ef-871b-19b2fe29181c 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:30 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=16, name=volume-1fa0e98e-03d2-49ef-871b-19b2fe29181c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:40:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1fa0e98e-03d2-49ef-871b-19b2fe29181c 1073741824" returned: 0 in 1.414s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1fa0e98e-03d2-49ef-871b-19b2fe29181c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1fa0e98e-03d2-49ef-871b-19b2fe29181c" returned: 0 in 0.632s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] <== create_volume: return (2429ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:40:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.465s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1567b4e-460e-4e9a-aa15-fca141cb7a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fa0e98e-03d2-49ef-871b-19b2fe29181c', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf329db-ee3e-4f6a-8c4b-a06b76f15641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:33 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Volume volume-1fa0e98e-03d2-49ef-871b-19b2fe29181c (1fa0e98e-03d2-49ef-871b-19b2fe29181c): created successfully
Sep 10 13:40:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf329db-ee3e-4f6a-8c4b-a06b76f15641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Flow 'volume_create_manager' (a59a6624-2b72-4a28-8da3-0261ebd8f10b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:40:33 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-06616ed7-ae71-427c-a832-474355690988 tempest-VolumesActionsTest-732193090 None] Created volume successfully.
Sep 10 13:40:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Acquiring lock "cinder-1fa0e98e-03d2-49ef-871b-19b2fe29181c-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:40:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Lock "cinder-1fa0e98e-03d2-49ef-871b-19b2fe29181c-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:40:34 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:40:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Acquiring lock "cinder-quobyte-1fa0e98e-03d2-49ef-871b-19b2fe29181c" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:40:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Lock "cinder-quobyte-1fa0e98e-03d2-49ef-871b-19b2fe29181c" acquired by "delete_volume" :: waited 0.030s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:40:34 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e292bf-2cef-4f39-800d-53f0dd429dec]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:40:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1fa0e98e-03d2-49ef-871b-19b2fe29181c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:36 devstack quobyte-client[82845]: System call of process 88096 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:40:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1fa0e98e-03d2-49ef-871b-19b2fe29181c" returned: 0 in 1.723s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1fa0e98e-03d2-49ef-871b-19b2fe29181c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1fa0e98e-03d2-49ef-871b-19b2fe29181c" returned: 0 in 0.221s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Lock "cinder-quobyte-1fa0e98e-03d2-49ef-871b-19b2fe29181c" released by "delete_volume" :: held 2.335s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:40:38 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Created reservations ['66f6c6ef-08bc-4236-b21e-8970af0cc109', '7a6fdb15-f73c-43ab-81f6-379acf930ecb', 'ecbd5274-449b-4f3a-847a-170050984917', '32410822-6d0b-4147-8494-4acf3c98e8bb'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:40:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:40:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:40:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.309s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:39 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:40:39 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Deleted volume successfully.
Sep 10 13:40:39 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ca4a6186-18d6-4221-b08a-4499c4cbb8c3 tempest-VolumesActionsTest-1151728191 None] Lock "cinder-1fa0e98e-03d2-49ef-871b-19b2fe29181c-delete_volume" released by "delete_volume" :: held 5.345s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:40:41 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Flow 'volume_create_manager' (19905a33-76d7-4327-b700-113889e734da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bcee1c-6c1f-4b0c-826a-d6c5fd00beef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bcee1c-6c1f-4b0c-826a-d6c5fd00beef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-471915006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5dfece5-c6b9-4393-8aad-90c6675deb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634fda2a7e1c4624b96275327b2fcdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:41Z,use_quota=True,user_id='a34dc46865944985b131077a5d69ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1557ed5c-cf18-4c55-abfd-908472dd7180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1557ed5c-cf18-4c55-abfd-908472dd7180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b1d954-b8f0-406e-870f-d8f8accd13cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b1d954-b8f0-406e-870f-d8f8accd13cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5dfece5-c6b9-4393-8aad-90c6675deb0c', 'volume_name': 'volume-c5dfece5-c6b9-4393-8aad-90c6675deb0c', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a934384-4dd2-43e8-a8fd-cef0352fae68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a934384-4dd2-43e8-a8fd-cef0352fae68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9193d108-6ef2-4973-b636-34f42246b5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:41 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Volume c5dfece5-c6b9-4393-8aad-90c6675deb0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5dfece5-c6b9-4393-8aad-90c6675deb0c', 'volume_size': 1}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-471915006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5dfece5-c6b9-4393-8aad-90c6675deb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634fda2a7e1c4624b96275327b2fcdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:41Z,use_quota=True,user_id='a34dc46865944985b131077a5d69ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Creating volume c5dfece5-c6b9-4393-8aad-90c6675deb0c {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:40:41 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:40:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c5dfece5-c6b9-4393-8aad-90c6675deb0c 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:41 devstack quobyte-client[82845]: System call of process 88133 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:40:41 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=17, name=volume-c5dfece5-c6b9-4393-8aad-90c6675deb0c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:40:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c5dfece5-c6b9-4393-8aad-90c6675deb0c 1073741824" returned: 0 in 0.628s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c5dfece5-c6b9-4393-8aad-90c6675deb0c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c5dfece5-c6b9-4393-8aad-90c6675deb0c" returned: 0 in 0.118s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:42 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] <== create_volume: return (842ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:40:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9193d108-6ef2-4973-b636-34f42246b5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5dfece5-c6b9-4393-8aad-90c6675deb0c', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b3bf4d-7ce6-4e13-b367-14c027c0c521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:43 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Volume volume-c5dfece5-c6b9-4393-8aad-90c6675deb0c (c5dfece5-c6b9-4393-8aad-90c6675deb0c): created successfully
Sep 10 13:40:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b3bf4d-7ce6-4e13-b367-14c027c0c521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Flow 'volume_create_manager' (19905a33-76d7-4327-b700-113889e734da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:40:43 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a176d9b4-db79-4661-887a-08fa13f97fbf tempest-VolumesActionsTest-732193090 None] Created volume successfully.
Sep 10 13:40:44 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Acquiring lock "cinder-c5dfece5-c6b9-4393-8aad-90c6675deb0c-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:40:44 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Lock "cinder-c5dfece5-c6b9-4393-8aad-90c6675deb0c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:40:44 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:40:44 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Acquiring lock "cinder-quobyte-c5dfece5-c6b9-4393-8aad-90c6675deb0c" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:40:44 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Lock "cinder-quobyte-c5dfece5-c6b9-4393-8aad-90c6675deb0c" acquired by "delete_volume" :: waited 0.016s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:40:44 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[812ed62a-979c-415f-a455-1c7cba67b821]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:40:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c5dfece5-c6b9-4393-8aad-90c6675deb0c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c5dfece5-c6b9-4393-8aad-90c6675deb0c" returned: 0 in 0.490s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c5dfece5-c6b9-4393-8aad-90c6675deb0c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c5dfece5-c6b9-4393-8aad-90c6675deb0c" returned: 0 in 0.085s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:45 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Lock "cinder-quobyte-c5dfece5-c6b9-4393-8aad-90c6675deb0c" released by "delete_volume" :: held 0.724s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:40:45 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Created reservations ['3e615dea-6118-4a26-adf8-9d925123e9dd', 'e6eb6713-b611-4c51-a896-9eb75373c5d5', 'af09f236-e0da-4fe3-b65a-d79a91a61923', '046cc3a0-9b97-4fa0-8869-17ed93735ed9'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:40:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:46 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:40:46 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:40:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.118s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:46 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:40:46 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Deleted volume successfully.
Sep 10 13:40:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-99c3a20b-01ff-4ce9-af65-f9e4443b6f83 tempest-VolumesActionsTest-1151728191 None] Lock "cinder-c5dfece5-c6b9-4393-8aad-90c6675deb0c-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:40:47 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:40:47 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:40:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Flow 'volume_create_manager' (4d1a59a0-e398-4280-a193-d1878f35b794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:40:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12bad58-1b40-4976-9323-42de4dc2b789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12bad58-1b40-4976-9323-42de4dc2b789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1287758560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d6e878-4d39-4d3c-aa75-031f4334c13f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634fda2a7e1c4624b96275327b2fcdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:48Z,use_quota=True,user_id='a34dc46865944985b131077a5d69ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927d6737-7fe5-4daa-b259-06da938a09e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927d6737-7fe5-4daa-b259-06da938a09e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf3d0ce-7475-462a-89c0-267577f675d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf3d0ce-7475-462a-89c0-267577f675d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98d6e878-4d39-4d3c-aa75-031f4334c13f', 'volume_name': 'volume-98d6e878-4d39-4d3c-aa75-031f4334c13f', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f04c27e-f703-4d35-82b0-555289834289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f04c27e-f703-4d35-82b0-555289834289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7377d30-96eb-4b94-9044-2d106913c719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:48 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Volume 98d6e878-4d39-4d3c-aa75-031f4334c13f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98d6e878-4d39-4d3c-aa75-031f4334c13f', 'volume_size': 1}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1287758560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d6e878-4d39-4d3c-aa75-031f4334c13f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634fda2a7e1c4624b96275327b2fcdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:40:48Z,use_quota=True,user_id='a34dc46865944985b131077a5d69ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Creating volume 98d6e878-4d39-4d3c-aa75-031f4334c13f {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:40:48 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-98d6e878-4d39-4d3c-aa75-031f4334c13f 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:48 devstack quobyte-client[82845]: System call of process 88143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:40:48 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=18, name=volume-98d6e878-4d39-4d3c-aa75-031f4334c13f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-98d6e878-4d39-4d3c-aa75-031f4334c13f 1073741824" returned: 0 in 0.386s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-98d6e878-4d39-4d3c-aa75-031f4334c13f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-98d6e878-4d39-4d3c-aa75-031f4334c13f" returned: 0 in 0.400s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:49 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] <== create_volume: return (968ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:40:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:49 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7377d30-96eb-4b94-9044-2d106913c719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98d6e878-4d39-4d3c-aa75-031f4334c13f', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:49 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807955f6-0fa0-44c7-9628-36fd73a601cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:40:49 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Volume volume-98d6e878-4d39-4d3c-aa75-031f4334c13f (98d6e878-4d39-4d3c-aa75-031f4334c13f): created successfully
Sep 10 13:40:49 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807955f6-0fa0-44c7-9628-36fd73a601cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:40:49 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Flow 'volume_create_manager' (4d1a59a0-e398-4280-a193-d1878f35b794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:40:49 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-8e772b77-8490-4486-90a4-0094bce2efe7 tempest-VolumesActionsTest-732193090 None] Created volume successfully.
Sep 10 13:40:51 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Acquiring lock "cinder-98d6e878-4d39-4d3c-aa75-031f4334c13f-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:40:51 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Lock "cinder-98d6e878-4d39-4d3c-aa75-031f4334c13f-delete_volume" acquired by "delete_volume" :: waited 0.193s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:40:52 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:40:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Acquiring lock "cinder-quobyte-98d6e878-4d39-4d3c-aa75-031f4334c13f" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:40:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Lock "cinder-quobyte-98d6e878-4d39-4d3c-aa75-031f4334c13f" acquired by "delete_volume" :: waited 0.051s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:40:52 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f6a59d-724a-446d-8c05-3eba882e0094]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:40:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-98d6e878-4d39-4d3c-aa75-031f4334c13f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:53 devstack quobyte-client[82845]: System call of process 88148 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:40:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-98d6e878-4d39-4d3c-aa75-031f4334c13f" returned: 0 in 0.958s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-98d6e878-4d39-4d3c-aa75-031f4334c13f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-98d6e878-4d39-4d3c-aa75-031f4334c13f" returned: 0 in 0.206s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Lock "cinder-quobyte-98d6e878-4d39-4d3c-aa75-031f4334c13f" released by "delete_volume" :: held 1.754s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:40:54 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Created reservations ['0097922f-22c6-4d0a-a324-7228fa830bf1', 'c5f4a2c9-dc7f-4f92-b6c7-f09f15b63e1b', '7a8a70e6-21b0-4880-97d0-32a26c343fac', '0a021051-8b63-4c7e-8567-b990e2fde3be'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:40:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:40:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:40:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:40:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:40:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:40:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:40:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.220s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:40:55 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:40:56 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Deleted volume successfully.
Sep 10 13:40:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c70c29e2-b622-48ef-848e-5da88151a734 tempest-VolumesActionsTest-732193090 None] Lock "cinder-98d6e878-4d39-4d3c-aa75-031f4334c13f-delete_volume" released by "delete_volume" :: held 5.171s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:41:05 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=31,cinder:UPDATE=46,cinder:DELETE=5,cinder:INSERT=6 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:41:06 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=54,cinder:SELECT=29,cinder:INSERT=14,cinder:DELETE=5 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:41:19 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Flow 'volume_create_manager' (ffd4052a-3b4c-4f90-b6bf-92ac9657a187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c932a459-7407-46e9-b1a3-758b4d0c3608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c932a459-7407-46e9-b1a3-758b4d0c3608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1799108110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e98b28-8cbd-46e7-a69f-a670a9776f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9fbeef82448441c8bd79275d5055a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:41:19Z,use_quota=True,user_id='a2bc091a72b24cb09342e71661b07d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec63d79-103d-4899-8dcf-ffe90d596a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec63d79-103d-4899-8dcf-ffe90d596a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76691016-4b64-4fcd-8f37-1d606ee7e8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76691016-4b64-4fcd-8f37-1d606ee7e8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e98b28-8cbd-46e7-a69f-a670a9776f31', 'volume_name': 'volume-24e98b28-8cbd-46e7-a69f-a670a9776f31', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bcb3a7-da85-485d-bdbd-3aa6a95c50d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bcb3a7-da85-485d-bdbd-3aa6a95c50d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9092876-c63a-4584-9a94-79e3cffa0965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:19 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Volume 24e98b28-8cbd-46e7-a69f-a670a9776f31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e98b28-8cbd-46e7-a69f-a670a9776f31', 'volume_size': 1}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1799108110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e98b28-8cbd-46e7-a69f-a670a9776f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9fbeef82448441c8bd79275d5055a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:41:19Z,use_quota=True,user_id='a2bc091a72b24cb09342e71661b07d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Creating volume 24e98b28-8cbd-46e7-a69f-a670a9776f31 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:41:19 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-24e98b28-8cbd-46e7-a69f-a670a9776f31 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:19 devstack quobyte-client[82845]: System call of process 88274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:41:19 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=19, name=volume-24e98b28-8cbd-46e7-a69f-a670a9776f31, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-24e98b28-8cbd-46e7-a69f-a670a9776f31 1073741824" returned: 0 in 0.557s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-24e98b28-8cbd-46e7-a69f-a670a9776f31 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-24e98b28-8cbd-46e7-a69f-a670a9776f31" returned: 0 in 0.148s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] <== create_volume: return (796ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:41:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:41:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9092876-c63a-4584-9a94-79e3cffa0965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e98b28-8cbd-46e7-a69f-a670a9776f31', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8034ccd6-223d-49e5-a823-b7cf2dd05022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:20 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Volume volume-24e98b28-8cbd-46e7-a69f-a670a9776f31 (24e98b28-8cbd-46e7-a69f-a670a9776f31): created successfully
Sep 10 13:41:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8034ccd6-223d-49e5-a823-b7cf2dd05022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Flow 'volume_create_manager' (ffd4052a-3b4c-4f90-b6bf-92ac9657a187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:41:20 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-0cc20ffa-5ed4-44a5-b3c4-35a452ab6a2c tempest-DeleteServersTestJSON-1597813771 None] Created volume successfully.
Sep 10 13:41:23 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:41:23 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:41:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Flow 'volume_create_manager' (9cf1fbca-7343-4ff4-98ca-98708f8a9f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:41:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2c7919-8132-4600-a5c9-d8397df506bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2c7919-8132-4600-a5c9-d8397df506bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1023159655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff09f164-be98-4cfa-a548-00d51f4bd230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26a1cf9cb8d49a2993261fdb69e0936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:41:23Z,use_quota=True,user_id='f3120324d07f4ac0be51060c158f4ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996d3cce-68ce-4b2c-b8af-d419643aff65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996d3cce-68ce-4b2c-b8af-d419643aff65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b80f4f8-9d63-4787-9b24-a2fe19e99405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b80f4f8-9d63-4787-9b24-a2fe19e99405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ff09f164-be98-4cfa-a548-00d51f4bd230', 'volume_name': 'volume-ff09f164-be98-4cfa-a548-00d51f4bd230', 'volume_size': 1, 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02b5bb39d7434620bf21786ff3aad29c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'created_at': datetime.datetime(2025, 9, 10, 11, 23, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 23, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f8481a-df2c-4f8b-8548-87d289ce329e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b5b2fa90>}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb733d4e-8c4d-43ad-b9ce-c2825dd3cd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb733d4e-8c4d-43ad-b9ce-c2825dd3cd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2651501-75ec-48af-8a98-3bf0b4f0f188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:24 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Volume ff09f164-be98-4cfa-a548-00d51f4bd230: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ff09f164-be98-4cfa-a548-00d51f4bd230', 'volume_size': 1, 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02b5bb39d7434620bf21786ff3aad29c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'created_at': datetime.datetime(2025, 9, 10, 11, 23, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 23, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f8481a-df2c-4f8b-8548-87d289ce329e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b5b2fa90>}
Sep 10 13:41:24 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Cloning ff09f164-be98-4cfa-a548-00d51f4bd230 from image b4f8481a-df2c-4f8b-8548-87d289ce329e  at location (None, None). {{(pid=82823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 13:41:25 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_rr4yw7_udevstack@QuobyteHD, size 20.69 MB, duration 1.17 sec {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 13:41:25 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Image download 20.69 MB at 17.63 MB/s
Sep 10 13:41:25 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f441aa-5462-4b82-a294-d32f3323735d]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:41:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_rr4yw7_udevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:26 devstack sudo[88292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_rr4yw7_udevstack@QuobyteHD
Sep 10 13:41:26 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:41:28 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:41:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:41:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:41:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:41:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:41:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:41:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 1.153s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:41:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-8e35726e-b684-4545-ad50-0e3dd5e3ff5a req-a19e90b3-443d-4d1d-b20c-e911f6dd9e65 tempest-DeleteServersTestJSON-1597813771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:41:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-8e35726e-b684-4545-ad50-0e3dd5e3ff5a req-a19e90b3-443d-4d1d-b20c-e911f6dd9e65 tempest-DeleteServersTestJSON-1597813771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.029s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:41:29 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d2fb9a-a3be-483e-8a48-84c019fb6553]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:41:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-8e35726e-b684-4545-ad50-0e3dd5e3ff5a req-a19e90b3-443d-4d1d-b20c-e911f6dd9e65 tempest-DeleteServersTestJSON-1597813771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-24e98b28-8cbd-46e7-a69f-a670a9776f31 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:30 devstack quobyte-client[82845]: System call of process 88314 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:41:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-8e35726e-b684-4545-ad50-0e3dd5e3ff5a req-a19e90b3-443d-4d1d-b20c-e911f6dd9e65 tempest-DeleteServersTestJSON-1597813771 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-24e98b28-8cbd-46e7-a69f-a670a9776f31" returned: 0 in 1.237s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-8e35726e-b684-4545-ad50-0e3dd5e3ff5a req-a19e90b3-443d-4d1d-b20c-e911f6dd9e65 tempest-DeleteServersTestJSON-1597813771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.443s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:41:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8e35726e-b684-4545-ad50-0e3dd5e3ff5a req-a19e90b3-443d-4d1d-b20c-e911f6dd9e65 tempest-DeleteServersTestJSON-1597813771 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-24e98b28-8cbd-46e7-a69f-a670a9776f31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a919d7d0-50e0-4877-a94d-1226142af766', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:41:31 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-8e35726e-b684-4545-ad50-0e3dd5e3ff5a req-a19e90b3-443d-4d1d-b20c-e911f6dd9e65 tempest-DeleteServersTestJSON-1597813771 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:41:32 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-8e35726e-b684-4545-ad50-0e3dd5e3ff5a req-a19e90b3-443d-4d1d-b20c-e911f6dd9e65 tempest-DeleteServersTestJSON-1597813771 None] attachment_update completed successfully.
Sep 10 13:41:32 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root
Sep 10 13:41:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_rr4yw7_udevstack@QuobyteHD" returned: 0 in 6.831s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:32 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Temporary image b4f8481a-df2c-4f8b-8548-87d289ce329e is fetched for user f3120324d07f4ac0be51060c158f4ad2. {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 13:41:32 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[16addd6d-87ba-4c28-92b0-0258bbd7bf89]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:41:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_rr4yw7_udevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:33 devstack sudo[88326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_rr4yw7_udevstack@QuobyteHD
Sep 10 13:41:33 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:41:37 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root
Sep 10 13:41:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_rr4yw7_udevstack@QuobyteHD" returned: 0 in 4.709s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:41:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:41:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1023159655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff09f164-be98-4cfa-a548-00d51f4bd230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26a1cf9cb8d49a2993261fdb69e0936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:41:23Z,use_quota=True,user_id='f3120324d07f4ac0be51060c158f4ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:41:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Creating volume ff09f164-be98-4cfa-a548-00d51f4bd230 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:41:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:41:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:41:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:41:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:41:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:41:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:41:37 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:41:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:37 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=20, name=volume-ff09f164-be98-4cfa-a548-00d51f4bd230, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:41:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230 1073741824" returned: 0 in 0.385s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230" returned: 0 in 0.219s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] <== create_volume: return (790ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:41:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:41:38 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Attempting download of b4f8481a-df2c-4f8b-8548-87d289ce329e ((None, None)) to volume ff09f164-be98-4cfa-a548-00d51f4bd230. {{(pid=82823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 13:41:38 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffb0822-b2f5-49c9-875b-3729f5438624]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:41:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_yri_mr28 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_yri_mr28" returned: 0 in 0.702s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_yri_mr28 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_yri_mr28" returned: 1 in 0.971s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_yri_mr28' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 13:41:40 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[549f4496-7b49-47d7-99b5-5ed1d8391864]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:41:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_rr4yw7_udevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_rr4yw7_udevstack@QuobyteHD" returned: 0 in 1.016s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:41 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] b4f8481a-df2c-4f8b-8548-87d289ce329e was qcow2, converting to raw {{(pid=82823) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 13:41:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_rr4yw7_udevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:42 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=20, name=volume-ff09f164-be98-4cfa-a548-00d51f4bd230, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:41:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_rr4yw7_udevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230" returned: 0 in 2.363s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:44 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_rr4yw7_udevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230 {{(pid=82823) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 13:41:44 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Converted 112.00 MB image at 46.33 MB/s
Sep 10 13:41:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230 1G" returned: 0 in 0.261s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:44 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2f77da-f459-457f-92ea-0db06782a3c6]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:41:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230" returned: 0 in 1.306s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230" returned: 1 in 0.724s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 13:41:47 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Downloaded image b4f8481a-df2c-4f8b-8548-87d289ce329e ((None, None)) to volume ff09f164-be98-4cfa-a548-00d51f4bd230 successfully. {{(pid=82823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 13:41:47 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Temporary image b4f8481a-df2c-4f8b-8548-87d289ce329e for user f3120324d07f4ac0be51060c158f4ad2 is deleted. {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 13:41:47 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Marking volume ff09f164-be98-4cfa-a548-00d51f4bd230 as bootable. {{(pid=82823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 13:41:47 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Copying metadata from image b4f8481a-df2c-4f8b-8548-87d289ce329e to ff09f164-be98-4cfa-a548-00d51f4bd230. {{(pid=82823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 13:41:47 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Creating volume glance metadata for volume ff09f164-be98-4cfa-a548-00d51f4bd230 backed by image b4f8481a-df2c-4f8b-8548-87d289ce329e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 13:41:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2651501-75ec-48af-8a98-3bf0b4f0f188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff09f164-be98-4cfa-a548-00d51f4bd230', 'volume_size': 1, 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02b5bb39d7434620bf21786ff3aad29c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'created_at': datetime.datetime(2025, 9, 10, 11, 23, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 23, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f8481a-df2c-4f8b-8548-87d289ce329e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b5b2fa90>}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d56a90-de67-4738-b0f8-89b6717d06f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:47 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-0ba70ef2-03a4-4e04-a53c-30ecacbafd60 req-d11aa421-e38f-40d0-8922-f14e32935a4b tempest-DeleteServersTestJSON-1597813771 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:41:47 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-0ba70ef2-03a4-4e04-a53c-30ecacbafd60 req-d11aa421-e38f-40d0-8922-f14e32935a4b tempest-DeleteServersTestJSON-1597813771 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:41:47 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-0ba70ef2-03a4-4e04-a53c-30ecacbafd60 req-d11aa421-e38f-40d0-8922-f14e32935a4b tempest-DeleteServersTestJSON-1597813771 None] Terminate volume connection completed successfully.
Sep 10 13:41:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-0ba70ef2-03a4-4e04-a53c-30ecacbafd60 req-d11aa421-e38f-40d0-8922-f14e32935a4b tempest-DeleteServersTestJSON-1597813771 None] Deleting attachment a919d7d0-50e0-4877-a94d-1226142af766. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:41:47 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Volume volume-ff09f164-be98-4cfa-a548-00d51f4bd230 (ff09f164-be98-4cfa-a548-00d51f4bd230): created successfully
Sep 10 13:41:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d56a90-de67-4738-b0f8-89b6717d06f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Flow 'volume_create_manager' (9cf1fbca-7343-4ff4-98ca-98708f8a9f3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:41:47 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-d8f200d5-9c7e-47a6-a5d8-893c69644739 tempest-VolumesImageMetadata-666445613 None] Created volume successfully.
Sep 10 13:41:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Acquiring lock "cinder-ff09f164-be98-4cfa-a548-00d51f4bd230-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:41:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Lock "cinder-ff09f164-be98-4cfa-a548-00d51f4bd230-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:41:49 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:41:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Acquiring lock "cinder-quobyte-ff09f164-be98-4cfa-a548-00d51f4bd230" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:41:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Lock "cinder-quobyte-ff09f164-be98-4cfa-a548-00d51f4bd230" acquired by "delete_volume" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:41:49 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8a6e30-e295-471a-a1bc-ad4e1184cd79]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:41:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230" returned: 0 in 0.430s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230" returned: 1 in 0.379s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 13:41:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ff09f164-be98-4cfa-a548-00d51f4bd230" returned: 0 in 0.113s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:50 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Lock "cinder-quobyte-ff09f164-be98-4cfa-a548-00d51f4bd230" released by "delete_volume" :: held 1.169s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:41:50 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Created reservations ['3b630dc5-76b6-4be0-897a-731337b5fbb2', '0c964128-6ddb-4f79-b953-2875d5252483', 'b4574525-4370-42af-a24f-f948813e8c41', '9bef3a28-d337-48f6-b721-6fc337fb33e6'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:41:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:41:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:41:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:41:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:41:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:41:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.079s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:51 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:41:51 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Deleted volume successfully.
Sep 10 13:41:51 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-25cc78c7-cd4b-4d3c-bf90-b66f72deeabe tempest-VolumesImageMetadata-666445613 None] Lock "cinder-ff09f164-be98-4cfa-a548-00d51f4bd230-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:41:51 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Acquiring lock "cinder-24e98b28-8cbd-46e7-a69f-a670a9776f31-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:41:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Lock "cinder-24e98b28-8cbd-46e7-a69f-a670a9776f31-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:41:52 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:41:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Acquiring lock "cinder-quobyte-24e98b28-8cbd-46e7-a69f-a670a9776f31" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:41:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Lock "cinder-quobyte-24e98b28-8cbd-46e7-a69f-a670a9776f31" acquired by "delete_volume" :: waited 0.022s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:41:52 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[914cb4cd-eb5b-4015-8b6a-5094e936bd01]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:41:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-24e98b28-8cbd-46e7-a69f-a670a9776f31 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-24e98b28-8cbd-46e7-a69f-a670a9776f31" returned: 0 in 0.482s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-24e98b28-8cbd-46e7-a69f-a670a9776f31 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-24e98b28-8cbd-46e7-a69f-a670a9776f31" returned: 0 in 0.103s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Lock "cinder-quobyte-24e98b28-8cbd-46e7-a69f-a670a9776f31" released by "delete_volume" :: held 0.748s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:41:53 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Created reservations ['cac6406b-9139-4537-80bb-96655bbfda8c', 'd694d2be-cc24-4b3d-ab12-2fe6cf7f88f0', 'b9c18343-91da-4a0d-81a6-5e2bdfb18d29', 'e0575e44-cc47-438e-a4e1-1adca9734c01'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:41:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:41:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:41:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:41:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:41:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:41:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.091s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:53 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:41:53 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Deleted volume successfully.
Sep 10 13:41:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a7098e0e-5756-4f5e-b7e5-79cfd6960f6a tempest-DeleteServersTestJSON-1597813771 None] Lock "cinder-24e98b28-8cbd-46e7-a69f-a670a9776f31-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:41:56 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Flow 'volume_create_manager' (c4bf1991-7fc6-4492-b480-cef8d6f51bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5827250-d597-44e3-ab6a-5e1fcced7da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5827250-d597-44e3-ab6a-5e1fcced7da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-37153821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3653775c-3f51-4f56-800d-93b0d02dee32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d28d7263f4446c84e19b2bb2ef98cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:41:56Z,use_quota=True,user_id='28a81fa5c29e435082bbe276c5d5eabc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461be2c2-7884-496f-b994-6d409e8e77df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461be2c2-7884-496f-b994-6d409e8e77df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6d89ca-e8fc-4c35-a64c-7ff61357bd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6d89ca-e8fc-4c35-a64c-7ff61357bd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3653775c-3f51-4f56-800d-93b0d02dee32', 'volume_name': 'volume-3653775c-3f51-4f56-800d-93b0d02dee32', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3a12f0-3936-4fae-a04f-60274e6d0c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3a12f0-3936-4fae-a04f-60274e6d0c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eaeb43d-610d-486a-87e5-e69b49d1c546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:56 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Volume 3653775c-3f51-4f56-800d-93b0d02dee32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3653775c-3f51-4f56-800d-93b0d02dee32', 'volume_size': 1}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-37153821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3653775c-3f51-4f56-800d-93b0d02dee32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d28d7263f4446c84e19b2bb2ef98cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:41:56Z,use_quota=True,user_id='28a81fa5c29e435082bbe276c5d5eabc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Creating volume 3653775c-3f51-4f56-800d-93b0d02dee32 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:41:56 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:41:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3653775c-3f51-4f56-800d-93b0d02dee32 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:57 devstack quobyte-client[82845]: System call of process 88475 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:41:57 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=21, name=volume-3653775c-3f51-4f56-800d-93b0d02dee32, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:41:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3653775c-3f51-4f56-800d-93b0d02dee32 1073741824" returned: 0 in 0.630s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3653775c-3f51-4f56-800d-93b0d02dee32 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3653775c-3f51-4f56-800d-93b0d02dee32" returned: 0 in 0.145s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] <== create_volume: return (842ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:41:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:41:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eaeb43d-610d-486a-87e5-e69b49d1c546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3653775c-3f51-4f56-800d-93b0d02dee32', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779588b6-dc9c-4d99-a913-98601991f13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:41:58 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Volume volume-3653775c-3f51-4f56-800d-93b0d02dee32 (3653775c-3f51-4f56-800d-93b0d02dee32): created successfully
Sep 10 13:41:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779588b6-dc9c-4d99-a913-98601991f13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:41:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Flow 'volume_create_manager' (c4bf1991-7fc6-4492-b480-cef8d6f51bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:41:58 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f06af67f-b404-4953-8019-b4cbf4ca5caa tempest-AbsoluteLimitsTests-1834661614 None] Created volume successfully.
Sep 10 13:41:58 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Acquiring lock "cinder-3653775c-3f51-4f56-800d-93b0d02dee32-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:41:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Lock "cinder-3653775c-3f51-4f56-800d-93b0d02dee32-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:41:59 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:41:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Acquiring lock "cinder-quobyte-3653775c-3f51-4f56-800d-93b0d02dee32" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:41:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Lock "cinder-quobyte-3653775c-3f51-4f56-800d-93b0d02dee32" acquired by "delete_volume" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:41:59 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef147e9-43dc-4c08-9868-f4445a0a395f]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:41:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3653775c-3f51-4f56-800d-93b0d02dee32 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:41:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3653775c-3f51-4f56-800d-93b0d02dee32" returned: 0 in 0.602s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:41:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3653775c-3f51-4f56-800d-93b0d02dee32 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3653775c-3f51-4f56-800d-93b0d02dee32" returned: 0 in 0.131s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Lock "cinder-quobyte-3653775c-3f51-4f56-800d-93b0d02dee32" released by "delete_volume" :: held 0.978s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:42:00 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Created reservations ['96b3fe48-21f8-4f1a-ac7b-ec94f2780c03', '13fb46e8-256f-41e6-aca3-fcc7f7208995', '41555aaa-0744-491b-b19c-3b1a58979ecf', 'f68ce372-0972-4589-b4d7-67846f18219b'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:42:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:42:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:42:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:42:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:42:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:42:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.098s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:00 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:42:00 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Deleted volume successfully.
Sep 10 13:42:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bc64710c-38d9-4898-855d-bbd5daf8e161 tempest-AbsoluteLimitsTests-1834661614 None] Lock "cinder-3653775c-3f51-4f56-800d-93b0d02dee32-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:42:07 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Flow 'volume_create_manager' (e04c7bce-1c28-4b2d-b37e-7df2c54ca495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48a1b59e-0802-4dfb-b8f2-8ab83d23f193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48a1b59e-0802-4dfb-b8f2-8ab83d23f193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1822617038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='018d01fbdce84fac9a92ee6c2c41c05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:42:07Z,use_quota=True,user_id='a73622c344bb4affa286b0892a24380c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa0e185-ded2-4952-9bce-f1857b3571fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa0e185-ded2-4952-9bce-f1857b3571fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f27f167-29cc-425d-a083-ad4acf038618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f27f167-29cc-425d-a083-ad4acf038618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b', 'volume_name': 'volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6cb0e46-e97b-481d-8899-1d52089e6188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6cb0e46-e97b-481d-8899-1d52089e6188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe4af11-da61-411c-8a76-4573a34922d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:07 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Volume 3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b', 'volume_size': 1}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1822617038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='018d01fbdce84fac9a92ee6c2c41c05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:42:07Z,use_quota=True,user_id='a73622c344bb4affa286b0892a24380c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Creating volume 3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:42:07 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:07 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=22, name=volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b 1073741824" returned: 0 in 0.369s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b" returned: 0 in 0.132s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] <== create_volume: return (574ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:42:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.597s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:42:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe4af11-da61-411c-8a76-4573a34922d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf0338c-0f5f-4c2f-9eb1-de58385c943e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:08 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Volume volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b (3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b): created successfully
Sep 10 13:42:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf0338c-0f5f-4c2f-9eb1-de58385c943e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Flow 'volume_create_manager' (e04c7bce-1c28-4b2d-b37e-7df2c54ca495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:42:08 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-43216ee0-17d0-4a78-a0a4-aa922b0a015f tempest-VolumesDeleteCascade-1798314687 None] Created volume successfully.
Sep 10 13:42:08 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-7f66b9ce-aa87-4384-8e3c-856b6d7254dc req-71880f3a-f777-4f54-af26-f3a85b8ad1e1 tempest-AttachVolumeTestJSON-1032577895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:42:08 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-7f66b9ce-aa87-4384-8e3c-856b6d7254dc req-71880f3a-f777-4f54-af26-f3a85b8ad1e1 tempest-AttachVolumeTestJSON-1032577895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:42:08 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-7f66b9ce-aa87-4384-8e3c-856b6d7254dc req-71880f3a-f777-4f54-af26-f3a85b8ad1e1 tempest-AttachVolumeTestJSON-1032577895 None] Terminate volume connection completed successfully.
Sep 10 13:42:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-7f66b9ce-aa87-4384-8e3c-856b6d7254dc req-71880f3a-f777-4f54-af26-f3a85b8ad1e1 tempest-AttachVolumeTestJSON-1032577895 None] Deleting attachment 1be02038-ca3e-40f6-82c5-d311ea15fbcc. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:42:09 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:42:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:42:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:42:09 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] Creating offline snapshot 7436da0f-bdc6-4751-857c-0cb7cff8d6b6 of volume 3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 13:42:09 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6426246-50ee-4843-a662-4ea78bfa2aa0]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:42:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b" returned: 0 in 0.612s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:10 devstack quobyte-client[82845]: System call of process 88507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:42:10 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=23, name=volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:42:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 1G" returned: 0 in 0.421s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] CMD "qemu-img rebase -u -b volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6" returned: 0 in 0.204s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:42:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6" returned: 0 in 0.518s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 13:42:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6" returned: 0 in 0.531s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.info" returned: 0 in 0.225s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:13 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:42:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.info" returned: 0 in 0.238s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.629s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:42:13 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-68bcb30c-0cde-4ec3-a261-3fdf0e1019aa tempest-VolumesDeleteCascade-1798314687 None] Create snapshot completed successfully
Sep 10 13:42:15 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:42:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:42:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:42:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] Creating offline snapshot 087ff30f-785a-4138-86ee-b4b4c04b0964 of volume 3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 13:42:15 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e46da1-9fdd-455e-b6e0-c499eceaa102]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:42:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6" returned: 0 in 0.511s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:42:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:16 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=25, name=volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:42:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964 1G" returned: 0 in 0.370s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] CMD "qemu-img rebase -u -b volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964" returned: 0 in 0.211s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:42:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964" returned: 0 in 0.125s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 13:42:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964" returned: 0 in 0.122s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.736s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:42:17 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=41,cinder:UPDATE=38,cinder:INSERT=12,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:42:17 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=37,cinder:SELECT=34,cinder:DELETE=7,cinder:INSERT=13 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:42:17 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-7868585c-932b-4887-97cf-fadf2fca7f8e tempest-VolumesDeleteCascade-1798314687 None] Create snapshot completed successfully
Sep 10 13:42:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:42:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:42:18 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:42:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Performing cascade delete. {{(pid=82823) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 10 13:42:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-087ff30f-785a-4138-86ee-b4b4c04b0964-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:42:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-087ff30f-785a-4138-86ee-b4b4c04b0964-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:42:18 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:42:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-quobyte-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:42:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:42:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-quobyte-087ff30f-785a-4138-86ee-b4b4c04b0964" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:42:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-087ff30f-785a-4138-86ee-b4b4c04b0964" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:42:18 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Deleting offline snapshot 087ff30f-785a-4138-86ee-b4b4c04b0964 of volume 3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 13:42:18 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] snapshot_file for this snap is: volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 13:42:18 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[99638a18-12c3-41e1-811a-7c45ab1326c1]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:42:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:19 devstack quobyte-client[82845]: System call of process 88571 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:42:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964" returned: 0 in 0.729s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:42:19 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4cc50c-4a21-48e0-b47b-e41bac55c688]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:42:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:20 devstack quobyte-client[82845]: System call of process 88575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:42:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6" returned: 0 in 0.745s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:42:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964" returned: 0 in 0.578s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.087ff30f-785a-4138-86ee-b4b4c04b0964" returned: 0 in 0.220s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:21 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-087ff30f-785a-4138-86ee-b4b4c04b0964" released by "_delete_snapshot" :: held 2.702s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:42:21 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b" released by "delete_snapshot" :: held 2.739s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:42:21 devstack cinder-volume[82823]: WARNING cinder.quota [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 10 13:42:21 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Created reservations ['7157afd8-409d-4eac-8d8e-b489bf707cb1', '5955179c-e52c-4c98-8918-7d8c7179c680', 'fac7be17-e697-407f-8348-e4addacb1087', '6d0cf3fb-0a51-4ea0-97f5-577ff84c5683'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:42:22 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Delete snapshot completed successfully.
Sep 10 13:42:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-087ff30f-785a-4138-86ee-b4b4c04b0964-delete_snapshot" released by "delete_snapshot" :: held 3.353s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:42:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-7436da0f-bdc6-4751-857c-0cb7cff8d6b6-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:42:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-7436da0f-bdc6-4751-857c-0cb7cff8d6b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:42:22 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:42:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-quobyte-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:42:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:42:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-quobyte-7436da0f-bdc6-4751-857c-0cb7cff8d6b6" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:42:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-7436da0f-bdc6-4751-857c-0cb7cff8d6b6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:42:22 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Deleting offline snapshot 7436da0f-bdc6-4751-857c-0cb7cff8d6b6 of volume 3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 13:42:22 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] snapshot_file for this snap is: volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 13:42:22 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[0824bcf3-5134-4cb9-8b23-fbc2d6f0c9cd]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:42:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:23 devstack quobyte-client[82845]: System call of process 88589 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:42:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6" returned: 0 in 1.069s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:42:23 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[344692bf-91b2-4143-afdb-15780be507b2]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:42:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b" returned: 0 in 0.713s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6" returned: 0 in 0.547s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b.7436da0f-bdc6-4751-857c-0cb7cff8d6b6" returned: 0 in 0.134s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-7436da0f-bdc6-4751-857c-0cb7cff8d6b6" released by "_delete_snapshot" :: held 2.844s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:42:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b" released by "delete_snapshot" :: held 2.874s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:42:25 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Created reservations ['07a84aff-4837-4e71-aa43-76a253bb3bd0', '703fa282-fae7-4a24-92d2-8bf00e0db6e8', '0fb884c2-a19f-4b9d-80dd-633f944e2805', 'f3f0116d-79b5-46b5-b8ba-55e1e626a345'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:42:26 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Delete snapshot completed successfully.
Sep 10 13:42:26 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-7436da0f-bdc6-4751-857c-0cb7cff8d6b6-delete_snapshot" released by "delete_snapshot" :: held 3.872s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:42:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Snapshots deleted, issuing volume delete {{(pid=82823) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 10 13:42:26 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-quobyte-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:42:26 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b" acquired by "delete_volume" :: waited 0.020s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:42:26 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[3419e466-5b72-4591-8dc8-73bd22572912]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:42:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b" returned: 0 in 0.542s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b" returned: 0 in 0.161s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b" released by "delete_volume" :: held 1.067s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:42:27 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Created reservations ['54cf3942-4172-43f6-ae3f-198c54a91fee', '34981b32-e4fb-40c5-97f6-443104cad7a8', '74724ef5-b814-4bbb-897e-3f2af971356a', '526fbe2f-d61d-4051-8803-f83e61fb65da'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:42:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:42:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:42:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:42:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:42:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:42:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.231s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:28 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:42:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:42:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:42:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:42:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:42:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:42:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:28 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:42:28 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Deleted volume successfully.
Sep 10 13:42:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.565s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:42:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-40d1c121-3d82-43ca-a7fd-acb3215530a5 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-3c1a972d-52df-4dcf-bdfb-9b29b0f9bf4b-delete_volume" released by "delete_volume" :: held 10.574s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:42:30 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:42:30 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Flow 'volume_create_manager' (5602fa49-0d39-4009-adb2-df8a612e133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4db52f9-3f35-4be8-b858-4162d7377454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4db52f9-3f35-4be8-b858-4162d7377454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-490570727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f467eed9-95f9-4100-94c5-e2336d05d9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='018d01fbdce84fac9a92ee6c2c41c05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:42:30Z,use_quota=True,user_id='a73622c344bb4affa286b0892a24380c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541d7c73-9fc1-4412-af57-06b5f4009ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541d7c73-9fc1-4412-af57-06b5f4009ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fba96ad-4c4d-4c10-a8e3-88f99218df0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fba96ad-4c4d-4c10-a8e3-88f99218df0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f467eed9-95f9-4100-94c5-e2336d05d9c3', 'volume_name': 'volume-f467eed9-95f9-4100-94c5-e2336d05d9c3', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0517e43d-b000-4073-a90d-86b726f064b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0517e43d-b000-4073-a90d-86b726f064b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005eebdd-3ad3-442f-99e5-d5b443d65808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:31 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Volume f467eed9-95f9-4100-94c5-e2336d05d9c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f467eed9-95f9-4100-94c5-e2336d05d9c3', 'volume_size': 1}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-490570727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f467eed9-95f9-4100-94c5-e2336d05d9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='018d01fbdce84fac9a92ee6c2c41c05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:42:30Z,use_quota=True,user_id='a73622c344bb4affa286b0892a24380c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Creating volume f467eed9-95f9-4100-94c5-e2336d05d9c3 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:42:31 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:42:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:32 devstack quobyte-client[82845]: System call of process 88678 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:42:32 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=26, name=volume-f467eed9-95f9-4100-94c5-e2336d05d9c3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:42:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 1073741824" returned: 0 in 0.810s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3" returned: 0 in 0.146s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] <== create_volume: return (1173ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:42:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:42:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005eebdd-3ad3-442f-99e5-d5b443d65808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f467eed9-95f9-4100-94c5-e2336d05d9c3', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95fb8a8c-9070-4803-a50b-c5571701cd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:33 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Volume volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 (f467eed9-95f9-4100-94c5-e2336d05d9c3): created successfully
Sep 10 13:42:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95fb8a8c-9070-4803-a50b-c5571701cd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Flow 'volume_create_manager' (5602fa49-0d39-4009-adb2-df8a612e133f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:42:33 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-8f5720de-c24d-43f1-8984-7d2085d1d778 tempest-VolumesDeleteCascade-1798314687 None] Created volume successfully.
Sep 10 13:42:34 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:42:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:42:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.020s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:42:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] Creating offline snapshot 86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa of volume f467eed9-95f9-4100-94c5-e2336d05d9c3 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 13:42:34 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[982581f4-e2fd-4397-970c-f5636bc27b61]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:42:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:36 devstack quobyte-client[82845]: System call of process 88691 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:42:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3" returned: 0 in 1.623s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:37 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=27, name=volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:42:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa 1G" returned: 0 in 1.160s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] CMD "qemu-img rebase -u -b volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa" returned: 0 in 0.321s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:42:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa" returned: 0 in 0.291s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 13:42:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa" returned: 0 in 0.212s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.info" returned: 0 in 0.131s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:42:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.info" returned: 0 in 0.207s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.106s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:42:40 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-8cde96c0-b818-4ea1-a515-2ed1962672a7 tempest-VolumesDeleteCascade-1798314687 None] Create snapshot completed successfully
Sep 10 13:42:41 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:42:41 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Flow 'volume_create_manager' (340ee483-db68-45d4-a843-383e431fe7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bbef7b7-7777-485c-8de1-bc21b262ba2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bbef7b7-7777-485c-8de1-bc21b262ba2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-733535420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a821fd-d305-444c-9c47-11dcc31616aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='018d01fbdce84fac9a92ee6c2c41c05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:42:42Z,use_quota=True,user_id='a73622c344bb4affa286b0892a24380c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063847f9-7f69-4512-bd1d-f8854d10c656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063847f9-7f69-4512-bd1d-f8854d10c656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef17c634-e8b2-4c83-92ec-2e3510b72cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef17c634-e8b2-4c83-92ec-2e3510b72cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c4a821fd-d305-444c-9c47-11dcc31616aa', 'volume_name': 'volume-c4a821fd-d305-444c-9c47-11dcc31616aa', 'volume_size': 1, 'snapshot_id': '86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa'}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c19be6-99b8-428f-9d0a-f130804bb748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c19be6-99b8-428f-9d0a-f130804bb748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82fef2c8-5270-42c3-8679-6ba3b80bd5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:42:42 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Volume c4a821fd-d305-444c-9c47-11dcc31616aa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c4a821fd-d305-444c-9c47-11dcc31616aa', 'volume_size': 1, 'snapshot_id': '86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa'}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-quobyte-86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa-c4a821fd-d305-444c-9c47-11dcc31616aa" by "_create_volume_from_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa-c4a821fd-d305-444c-9c47-11dcc31616aa" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Creating volume c4a821fd-d305-444c-9c47-11dcc31616aa from snapshot 86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa {{(pid=82823) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-quobyte-c4a821fd-d305-444c-9c47-11dcc31616aa" by "_copy_volume_from_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-c4a821fd-d305-444c-9c47-11dcc31616aa" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] snapshot: 86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa, volume: c4a821fd-d305-444c-9c47-11dcc31616aa,  {{(pid=82823) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ddd329-343a-4c8e-a5a2-8523d4f232c6]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:42:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa" returned: 0 in 0.839s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f467eed9-95f9-4100-94c5-e2336d05d9c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:42:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 {{(pid=82823) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 13:42:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Creating direct copy from snapshot {{(pid=82823) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 13:42:43 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[828a1754-8909-4a1c-a59f-bccc473cfcaf]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:42:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3" returned: 0 in 0.934s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:44 devstack cinder-volume[82823]: DEBUG cinder.utils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a821fd-d305-444c-9c47-11dcc31616aa not found in is_blk_device check {{(pid=82823) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 13:42:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a821fd-d305-444c-9c47-11dcc31616aa {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:42:44 devstack quobyte-client[82845]: System call of process 88754 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:42:44 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=29, name=volume-c4a821fd-d305-444c-9c47-11dcc31616aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:42:52 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:DELETE=3,cinder:SELECT=22,cinder:INSERT=4,cinder:UPDATE=15 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:42:53 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=30,cinder:SELECT=18,cinder:INSERT=8,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:42:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a821fd-d305-444c-9c47-11dcc31616aa" returned: 0 in 14.636s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:42:59 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[770afc0a-4a65-400f-81b7-6f313623631a]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:42:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3" returned: 0 in 0.789s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3, size 1024.00 MB, duration 14.64 sec, destination /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a821fd-d305-444c-9c47-11dcc31616aa {{(pid=82823) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 13:43:00 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Converted 1024.00 MB image at 69.93 MB/s
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a821fd-d305-444c-9c47-11dcc31616aa is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a821fd-d305-444c-9c47-11dcc31616aa {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a821fd-d305-444c-9c47-11dcc31616aa" returned: 0 in 0.375s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-c4a821fd-d305-444c-9c47-11dcc31616aa" released by "_copy_volume_from_snapshot" :: held 18.011s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa-c4a821fd-d305-444c-9c47-11dcc31616aa" released by "_create_volume_from_snapshot" :: held 18.048s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 18.068s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:43:00 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Flow 'volume_create_manager' (b9c66977-eeaf-4240-b065-fc2b9e355c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc4e376-f133-4da7-9d89-a551aa747490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc4e376-f133-4da7-9d89-a551aa747490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-82665623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd1a8ae-2a95-4996-a005-7d05b8842210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ec2d699f4b48a0926a76f3ddf7ab6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:43:00Z,use_quota=True,user_id='2681813593fd4e72b053b3e38d6bfc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905e0603-e9d6-4463-a3db-842195324e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905e0603-e9d6-4463-a3db-842195324e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac55418-6a7a-4d60-912f-ab121211b7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac55418-6a7a-4d60-912f-ab121211b7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dd1a8ae-2a95-4996-a005-7d05b8842210', 'volume_name': 'volume-2dd1a8ae-2a95-4996-a005-7d05b8842210', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da887519-7ea1-4288-8517-15970d097d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da887519-7ea1-4288-8517-15970d097d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06163474-6e33-40f2-9437-837e6183dac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:00 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Volume 2dd1a8ae-2a95-4996-a005-7d05b8842210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dd1a8ae-2a95-4996-a005-7d05b8842210', 'volume_size': 1}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-82665623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd1a8ae-2a95-4996-a005-7d05b8842210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ec2d699f4b48a0926a76f3ddf7ab6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:43:00Z,use_quota=True,user_id='2681813593fd4e72b053b3e38d6bfc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Creating volume 2dd1a8ae-2a95-4996-a005-7d05b8842210 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:43:00 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:43:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dd1a8ae-2a95-4996-a005-7d05b8842210 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:00 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=30, name=volume-2dd1a8ae-2a95-4996-a005-7d05b8842210, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82fef2c8-5270-42c3-8679-6ba3b80bd5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a821fd-d305-444c-9c47-11dcc31616aa', 'volume_size': 1, 'snapshot_id': '86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa'}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d157ee75-7d46-4da9-9be0-1c82b758c97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dd1a8ae-2a95-4996-a005-7d05b8842210 1073741824" returned: 0 in 0.450s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dd1a8ae-2a95-4996-a005-7d05b8842210 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:01 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Volume volume-c4a821fd-d305-444c-9c47-11dcc31616aa (c4a821fd-d305-444c-9c47-11dcc31616aa): created successfully
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d157ee75-7d46-4da9-9be0-1c82b758c97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Flow 'volume_create_manager' (340ee483-db68-45d4-a843-383e431fe7ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dd1a8ae-2a95-4996-a005-7d05b8842210" returned: 0 in 0.296s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] <== create_volume: return (767ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06163474-6e33-40f2-9437-837e6183dac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dd1a8ae-2a95-4996-a005-7d05b8842210', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac52f33e-b175-4f10-b1dc-9a46446f3572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:01 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-11d63a4c-2137-41b7-a6d9-1e9543c3717d tempest-VolumesDeleteCascade-1798314687 None] Created volume successfully.
Sep 10 13:43:01 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Volume volume-2dd1a8ae-2a95-4996-a005-7d05b8842210 (2dd1a8ae-2a95-4996-a005-7d05b8842210): created successfully
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac52f33e-b175-4f10-b1dc-9a46446f3572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Flow 'volume_create_manager' (b9c66977-eeaf-4240-b065-fc2b9e355c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-f467eed9-95f9-4100-94c5-e2336d05d9c3-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-f467eed9-95f9-4100-94c5-e2336d05d9c3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:43:01 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-90bd1f46-323b-4535-981e-86d0faa3b542 tempest-TaggedAttachmentsTest-1943989061 None] Created volume successfully.
Sep 10 13:43:01 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Performing cascade delete. {{(pid=82823) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:43:01 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-quobyte-f467eed9-95f9-4100-94c5-e2336d05d9c3" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-f467eed9-95f9-4100-94c5-e2336d05d9c3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-quobyte-86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:43:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:43:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Deleting offline snapshot 86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa of volume f467eed9-95f9-4100-94c5-e2336d05d9c3 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 13:43:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] snapshot_file for this snap is: volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 13:43:02 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4675d1-1815-4fea-ac82-ff59f5b81d59]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:43:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:02 devstack quobyte-client[82845]: System call of process 88789 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:43:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa" returned: 0 in 0.634s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f467eed9-95f9-4100-94c5-e2336d05d9c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:43:02 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb55162-67c2-471d-94c7-1a18c3b9cc66]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:43:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3" returned: 0 in 0.650s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa" returned: 0 in 0.279s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3.86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa" returned: 0 in 0.115s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa" released by "_delete_snapshot" :: held 2.032s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:43:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-f467eed9-95f9-4100-94c5-e2336d05d9c3" released by "delete_snapshot" :: held 2.116s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:43:04 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Created reservations ['9800d770-b56b-41b3-b1d9-8b5d40f4249b', '92e7f683-e3ab-4a58-95ad-b0fa04d7842b', 'fa53ad9b-4250-4f3c-8ef6-73d1162157a9', '32ce7fdd-a6d7-45e9-922f-b37f1d0ac9c8'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:43:04 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Delete snapshot completed successfully.
Sep 10 13:43:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-86daeadb-6ec4-4e59-9bd0-dbd6fe7ad4fa-delete_snapshot" released by "delete_snapshot" :: held 2.609s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:43:04 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Snapshots deleted, issuing volume delete {{(pid=82823) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 10 13:43:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-quobyte-f467eed9-95f9-4100-94c5-e2336d05d9c3" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:43:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-f467eed9-95f9-4100-94c5-e2336d05d9c3" acquired by "delete_volume" :: waited 0.022s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:43:04 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[7405b16d-1d4a-466f-8848-e2c541c65342]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:43:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3" returned: 0 in 0.644s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f467eed9-95f9-4100-94c5-e2336d05d9c3" returned: 0 in 0.144s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-f467eed9-95f9-4100-94c5-e2336d05d9c3" released by "delete_volume" :: held 1.019s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:43:05 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Created reservations ['efb47cea-5cae-4f9a-8b3a-01d28f30df21', '4a89960b-3461-4ad5-8969-e2187b2b1489', 'c6ef1adc-03a1-4d71-81c9-e0c1ad1dc087', 'e6db24a6-b74f-42ab-b288-d5e386f66fe8'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:43:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:43:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:43:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:43:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:43:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:43:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.247s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:06 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:43:06 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Deleted volume successfully.
Sep 10 13:43:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-c4a821fd-d305-444c-9c47-11dcc31616aa-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:43:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-c4a821fd-d305-444c-9c47-11dcc31616aa-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:43:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-69740eeb-8fe0-46e7-8908-ccba366eee36 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-f467eed9-95f9-4100-94c5-e2336d05d9c3-delete_volume" released by "delete_volume" :: held 5.355s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:43:07 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:43:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "cinder-quobyte-c4a821fd-d305-444c-9c47-11dcc31616aa" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:43:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-c4a821fd-d305-444c-9c47-11dcc31616aa" acquired by "delete_volume" :: waited 0.011s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:43:07 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[447d454f-f7ad-48fd-b350-c632d8f371ad]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:43:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a821fd-d305-444c-9c47-11dcc31616aa {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a821fd-d305-444c-9c47-11dcc31616aa" returned: 0 in 0.612s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a821fd-d305-444c-9c47-11dcc31616aa {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a821fd-d305-444c-9c47-11dcc31616aa" returned: 0 in 0.140s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:08 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-quobyte-c4a821fd-d305-444c-9c47-11dcc31616aa" released by "delete_volume" :: held 1.013s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:43:08 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Created reservations ['e076bd13-2956-43f6-b462-9e9f2823719a', '466a639a-6379-45b8-bb95-25008dd0db11', '68af0d3f-2ab3-4d5b-8036-2041ee773050', 'f36d1a4d-729f-4dfc-965e-dc23bdc78f00'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:43:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:43:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:43:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:43:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:43:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:43:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.170s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:09 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:43:09 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Deleted volume successfully.
Sep 10 13:43:09 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6a335bf2-0709-4415-9bcc-2acea460c259 tempest-VolumesDeleteCascade-1798314687 None] Lock "cinder-c4a821fd-d305-444c-9c47-11dcc31616aa-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:43:15 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:43:15 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:43:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Flow 'volume_create_manager' (ac850a22-a1c6-4da2-96e7-6b49524713dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:43:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a79f97-0cec-41b1-b35e-e2f32b58090b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a79f97-0cec-41b1-b35e-e2f32b58090b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1664225378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f96aec-4342-4a27-bd2f-6258ccac4a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439ef450e7bf49e18a23928461a4c530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:43:16Z,use_quota=True,user_id='fcd1fcc803e64bbe9bbcb8370b5b4b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d756bbd-3b42-4920-a6bb-417c1b5ca2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d756bbd-3b42-4920-a6bb-417c1b5ca2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226c1055-b570-46ec-9d88-14b640824c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226c1055-b570-46ec-9d88-14b640824c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f96aec-4342-4a27-bd2f-6258ccac4a53', 'volume_name': 'volume-96f96aec-4342-4a27-bd2f-6258ccac4a53', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68cc3e5-301b-40e1-b00d-b61eddaf5c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68cc3e5-301b-40e1-b00d-b61eddaf5c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52921b5-6a38-4407-89ff-5e080bfafce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:16 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Volume 96f96aec-4342-4a27-bd2f-6258ccac4a53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f96aec-4342-4a27-bd2f-6258ccac4a53', 'volume_size': 1}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1664225378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f96aec-4342-4a27-bd2f-6258ccac4a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439ef450e7bf49e18a23928461a4c530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:43:16Z,use_quota=True,user_id='fcd1fcc803e64bbe9bbcb8370b5b4b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Creating volume 96f96aec-4342-4a27-bd2f-6258ccac4a53 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:43:16 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-96f96aec-4342-4a27-bd2f-6258ccac4a53 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:16 devstack quobyte-client[82845]: System call of process 88815 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:43:16 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=31, name=volume-96f96aec-4342-4a27-bd2f-6258ccac4a53, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-96f96aec-4342-4a27-bd2f-6258ccac4a53 1073741824" returned: 0 in 0.345s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-96f96aec-4342-4a27-bd2f-6258ccac4a53 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-96f96aec-4342-4a27-bd2f-6258ccac4a53" returned: 0 in 0.081s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] <== create_volume: return (485ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.496s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52921b5-6a38-4407-89ff-5e080bfafce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f96aec-4342-4a27-bd2f-6258ccac4a53', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36644811-e3dd-45e4-9487-b68cbeaa5228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:16 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Volume volume-96f96aec-4342-4a27-bd2f-6258ccac4a53 (96f96aec-4342-4a27-bd2f-6258ccac4a53): created successfully
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36644811-e3dd-45e4-9487-b68cbeaa5228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Flow 'volume_create_manager' (ac850a22-a1c6-4da2-96e7-6b49524713dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:43:16 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-1b8fbc02-1d8d-4b87-9884-b6b6c343af88 tempest-VolumesTransfersTest-1242364321 None] Created volume successfully.
Sep 10 13:43:18 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-8e3ea037-7ef0-495c-b149-1797e9643937 tempest-VolumesTransfersTest-534666260 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:43:18 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-8e3ea037-7ef0-495c-b149-1797e9643937 tempest-VolumesTransfersTest-534666260 None] Transfer volume completed successfully.
Sep 10 13:43:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Acquiring lock "cinder-96f96aec-4342-4a27-bd2f-6258ccac4a53-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:43:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Lock "cinder-96f96aec-4342-4a27-bd2f-6258ccac4a53-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:43:20 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:43:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Acquiring lock "cinder-quobyte-96f96aec-4342-4a27-bd2f-6258ccac4a53" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:43:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Lock "cinder-quobyte-96f96aec-4342-4a27-bd2f-6258ccac4a53" acquired by "delete_volume" :: waited 0.025s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:43:20 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8945eb6-cea9-4aa6-be35-bd930e032cea]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:43:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-96f96aec-4342-4a27-bd2f-6258ccac4a53 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:21 devstack quobyte-client[82845]: System call of process 88826 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:43:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-96f96aec-4342-4a27-bd2f-6258ccac4a53" returned: 0 in 0.769s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-96f96aec-4342-4a27-bd2f-6258ccac4a53 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-96f96aec-4342-4a27-bd2f-6258ccac4a53" returned: 0 in 0.295s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:21 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Lock "cinder-quobyte-96f96aec-4342-4a27-bd2f-6258ccac4a53" released by "delete_volume" :: held 1.352s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:43:22 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Created reservations ['2699fb20-5e79-409b-9db8-f109c226342f', '0eff2706-b9d9-4505-82da-631cfe96f1ae', '4fe1144f-44d8-4723-9648-0c8cbaedff92', '15414bce-a1d0-445d-a6c5-c460e5c72052'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:43:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:43:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:43:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:43:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:43:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:43:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.223s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:23 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:43:23 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Deleted volume successfully.
Sep 10 13:43:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0c93af7f-5258-43bb-a6d4-d24328b6498a tempest-VolumesTransfersTest-1196831597 None] Lock "cinder-96f96aec-4342-4a27-bd2f-6258ccac4a53-delete_volume" released by "delete_volume" :: held 3.290s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:43:25 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Flow 'volume_create_manager' (d5a76cb8-0a8e-4cc8-8ab4-0e5ba6fc22e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08334cea-0533-46e7-a462-acec8f7e5d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08334cea-0533-46e7-a462-acec8f7e5d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1512376359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2176166-c54a-4a34-bef4-aef44f9760f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439ef450e7bf49e18a23928461a4c530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:43:25Z,use_quota=True,user_id='fcd1fcc803e64bbe9bbcb8370b5b4b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec2bc38-a746-4c0a-823b-8953c3f34fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec2bc38-a746-4c0a-823b-8953c3f34fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebd798b-18f8-4fdf-8f8f-e33fde636cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebd798b-18f8-4fdf-8f8f-e33fde636cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2176166-c54a-4a34-bef4-aef44f9760f7', 'volume_name': 'volume-b2176166-c54a-4a34-bef4-aef44f9760f7', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe124a2-88eb-478a-9f71-c83f1de6968a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe124a2-88eb-478a-9f71-c83f1de6968a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5183642c-1cd3-4699-8883-868c3bed0ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:25 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Volume b2176166-c54a-4a34-bef4-aef44f9760f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2176166-c54a-4a34-bef4-aef44f9760f7', 'volume_size': 1}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1512376359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2176166-c54a-4a34-bef4-aef44f9760f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439ef450e7bf49e18a23928461a4c530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:43:25Z,use_quota=True,user_id='fcd1fcc803e64bbe9bbcb8370b5b4b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Creating volume b2176166-c54a-4a34-bef4-aef44f9760f7 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:43:25 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:43:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b2176166-c54a-4a34-bef4-aef44f9760f7 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:25 devstack quobyte-client[82845]: System call of process 88852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:43:25 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=32, name=volume-b2176166-c54a-4a34-bef4-aef44f9760f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:43:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b2176166-c54a-4a34-bef4-aef44f9760f7 1073741824" returned: 0 in 0.651s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b2176166-c54a-4a34-bef4-aef44f9760f7 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b2176166-c54a-4a34-bef4-aef44f9760f7" returned: 0 in 0.277s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:26 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] <== create_volume: return (1004ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:43:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:43:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5183642c-1cd3-4699-8883-868c3bed0ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2176166-c54a-4a34-bef4-aef44f9760f7', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac30d70e-682b-4c65-ab1c-da1546c6c131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:26 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Volume volume-b2176166-c54a-4a34-bef4-aef44f9760f7 (b2176166-c54a-4a34-bef4-aef44f9760f7): created successfully
Sep 10 13:43:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac30d70e-682b-4c65-ab1c-da1546c6c131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Flow 'volume_create_manager' (d5a76cb8-0a8e-4cc8-8ab4-0e5ba6fc22e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:43:27 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-0c49a6ba-2e65-4885-9c59-e2be6bb5db69 tempest-VolumesTransfersTest-1242364321 None] Created volume successfully.
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Acquiring lock "cinder-b2176166-c54a-4a34-bef4-aef44f9760f7-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Lock "cinder-b2176166-c54a-4a34-bef4-aef44f9760f7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:43:28 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Acquiring lock "cinder-quobyte-b2176166-c54a-4a34-bef4-aef44f9760f7" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Lock "cinder-quobyte-b2176166-c54a-4a34-bef4-aef44f9760f7" acquired by "delete_volume" :: waited 0.014s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[05da3d66-df12-4481-a694-8b321e4d995d]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b2176166-c54a-4a34-bef4-aef44f9760f7 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.175s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:43:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b2176166-c54a-4a34-bef4-aef44f9760f7" returned: 0 in 0.610s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b2176166-c54a-4a34-bef4-aef44f9760f7 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b2176166-c54a-4a34-bef4-aef44f9760f7" returned: 0 in 0.100s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Lock "cinder-quobyte-b2176166-c54a-4a34-bef4-aef44f9760f7" released by "delete_volume" :: held 0.970s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:43:29 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Created reservations ['b04401b3-3881-4931-8a79-61680aad1f40', '311e9a64-f211-4ac6-b8cb-b7fa1c234366', '9fe83b90-8a9a-4835-9bdc-668ce15b0cdd', '58e7d5af-a1b9-4f3a-b0bd-94f3256e83c4'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:43:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:43:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:43:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:43:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:43:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:43:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.248s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:43:30 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Deleted volume successfully.
Sep 10 13:43:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8a21c2b8-008e-474c-904d-80a3daf2d1c4 tempest-VolumesTransfersTest-1196831597 None] Lock "cinder-b2176166-c54a-4a34-bef4-aef44f9760f7-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:43:40 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=44,cinder:SELECT=24,cinder:INSERT=9,cinder:DELETE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:43:41 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=35,cinder:UPDATE=46,cinder:DELETE=6,cinder:INSERT=11 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:43:51 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Flow 'volume_create_manager' (9747574b-541c-4302-8143-b724a55ea3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800ddfb1-45ae-4d58-86f4-88400599777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800ddfb1-45ae-4d58-86f4-88400599777b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-635451634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38661b2-cc97-4175-84be-02c5cc35edc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1adcf610894592b4b8481465f0cec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:43:51Z,use_quota=True,user_id='22ef654bffaf454f8664ac9c5821672f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679449c3-ddac-4cc6-8205-0715f6b85699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679449c3-ddac-4cc6-8205-0715f6b85699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb7ca4e-7639-4f7c-8d2c-ae9c4f5ca583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb7ca4e-7639-4f7c-8d2c-ae9c4f5ca583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c38661b2-cc97-4175-84be-02c5cc35edc0', 'volume_name': 'volume-c38661b2-cc97-4175-84be-02c5cc35edc0', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b920ca-4027-4f9a-95b1-7595fde20dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b920ca-4027-4f9a-95b1-7595fde20dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f51a591-a5f8-4853-9605-09138c9e2383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:51 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Volume c38661b2-cc97-4175-84be-02c5cc35edc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c38661b2-cc97-4175-84be-02c5cc35edc0', 'volume_size': 1}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-635451634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38661b2-cc97-4175-84be-02c5cc35edc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1adcf610894592b4b8481465f0cec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:43:51Z,use_quota=True,user_id='22ef654bffaf454f8664ac9c5821672f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Creating volume c38661b2-cc97-4175-84be-02c5cc35edc0 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:43:51 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:43:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c38661b2-cc97-4175-84be-02c5cc35edc0 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:51 devstack quobyte-client[82845]: System call of process 89038 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:43:51 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=33, name=volume-c38661b2-cc97-4175-84be-02c5cc35edc0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:43:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c38661b2-cc97-4175-84be-02c5cc35edc0 1073741824" returned: 0 in 0.756s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c38661b2-cc97-4175-84be-02c5cc35edc0 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c38661b2-cc97-4175-84be-02c5cc35edc0" returned: 0 in 0.388s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] <== create_volume: return (1386ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:43:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:43:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f51a591-a5f8-4853-9605-09138c9e2383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c38661b2-cc97-4175-84be-02c5cc35edc0', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69c6d9a-36af-4ac9-96a2-d28b8088f2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:43:53 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Volume volume-c38661b2-cc97-4175-84be-02c5cc35edc0 (c38661b2-cc97-4175-84be-02c5cc35edc0): created successfully
Sep 10 13:43:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69c6d9a-36af-4ac9-96a2-d28b8088f2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:43:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Flow 'volume_create_manager' (9747574b-541c-4302-8143-b724a55ea3e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:43:53 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-89388dbd-1641-446f-8a1e-2f1f40f4f942 tempest-VolumesTransfersV355Test-1852730940 None] Created volume successfully.
Sep 10 13:43:55 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-533b708e-0a54-43e3-aab2-1fb3b258fa91 tempest-VolumesTransfersV355Test-1375049982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:43:55 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-533b708e-0a54-43e3-aab2-1fb3b258fa91 tempest-VolumesTransfersV355Test-1375049982 None] Transfer volume completed successfully.
Sep 10 13:43:56 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Acquiring lock "cinder-c38661b2-cc97-4175-84be-02c5cc35edc0-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:43:56 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Lock "cinder-c38661b2-cc97-4175-84be-02c5cc35edc0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:43:57 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:43:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Acquiring lock "cinder-quobyte-c38661b2-cc97-4175-84be-02c5cc35edc0" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:43:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Lock "cinder-quobyte-c38661b2-cc97-4175-84be-02c5cc35edc0" acquired by "delete_volume" :: waited 0.020s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:43:57 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb21b52-81f7-4fb6-a21f-33f93867cec0]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:43:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c38661b2-cc97-4175-84be-02c5cc35edc0 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c38661b2-cc97-4175-84be-02c5cc35edc0" returned: 0 in 0.577s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c38661b2-cc97-4175-84be-02c5cc35edc0 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c38661b2-cc97-4175-84be-02c5cc35edc0" returned: 0 in 0.115s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Lock "cinder-quobyte-c38661b2-cc97-4175-84be-02c5cc35edc0" released by "delete_volume" :: held 0.865s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:43:58 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Created reservations ['0edd48f7-93e3-4c97-b438-b758564e8cb1', '9b00aa1b-d9fc-4fc4-be98-a55174fef598', '3e9ac591-1813-496b-a82c-5b7c7466385f', 'c059debc-ff01-4b83-a250-8a62bbcf3059'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:43:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:43:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:43:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:43:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:43:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:43:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:43:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.128s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:43:58 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:43:58 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Deleted volume successfully.
Sep 10 13:43:58 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a209d3b4-1520-4eef-8a55-6a0886ee3f5e tempest-VolumesTransfersV355Test-364221776 None] Lock "cinder-c38661b2-cc97-4175-84be-02c5cc35edc0-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:44:00 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Flow 'volume_create_manager' (b206801b-3050-4631-aee8-8a00001f9ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3a4c73-335a-4ab7-9069-e66867bdfd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3a4c73-335a-4ab7-9069-e66867bdfd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2023215722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8aa110-f253-42cb-a724-315c2510f8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1adcf610894592b4b8481465f0cec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:44:00Z,use_quota=True,user_id='22ef654bffaf454f8664ac9c5821672f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee27af1a-bcb8-430a-91a9-9c1360e201d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee27af1a-bcb8-430a-91a9-9c1360e201d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7825a0df-7a7a-4320-b631-6a55a4c622dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7825a0df-7a7a-4320-b631-6a55a4c622dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac8aa110-f253-42cb-a724-315c2510f8d9', 'volume_name': 'volume-ac8aa110-f253-42cb-a724-315c2510f8d9', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ef0470-c5a4-4e0b-b12d-a3866651e9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ef0470-c5a4-4e0b-b12d-a3866651e9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fc62af-4fb9-4500-9258-33e6a16b1379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:00 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Volume ac8aa110-f253-42cb-a724-315c2510f8d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac8aa110-f253-42cb-a724-315c2510f8d9', 'volume_size': 1}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2023215722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8aa110-f253-42cb-a724-315c2510f8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1adcf610894592b4b8481465f0cec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:44:00Z,use_quota=True,user_id='22ef654bffaf454f8664ac9c5821672f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Creating volume ac8aa110-f253-42cb-a724-315c2510f8d9 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:44:00 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:44:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ac8aa110-f253-42cb-a724-315c2510f8d9 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:01 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=34, name=volume-ac8aa110-f253-42cb-a724-315c2510f8d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:44:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ac8aa110-f253-42cb-a724-315c2510f8d9 1073741824" returned: 0 in 0.622s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ac8aa110-f253-42cb-a724-315c2510f8d9 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ac8aa110-f253-42cb-a724-315c2510f8d9" returned: 0 in 0.231s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] <== create_volume: return (952ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:44:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:44:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fc62af-4fb9-4500-9258-33e6a16b1379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac8aa110-f253-42cb-a724-315c2510f8d9', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f777207-52b1-4b91-a097-55dd023b4b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:02 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Volume volume-ac8aa110-f253-42cb-a724-315c2510f8d9 (ac8aa110-f253-42cb-a724-315c2510f8d9): created successfully
Sep 10 13:44:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f777207-52b1-4b91-a097-55dd023b4b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Flow 'volume_create_manager' (b206801b-3050-4631-aee8-8a00001f9ef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:44:02 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-c1b9012b-2450-4a50-a798-cfd9feb6067f tempest-VolumesTransfersV355Test-1852730940 None] Created volume successfully.
Sep 10 13:44:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Acquiring lock "cinder-ac8aa110-f253-42cb-a724-315c2510f8d9-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:44:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Lock "cinder-ac8aa110-f253-42cb-a724-315c2510f8d9-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:44:03 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:44:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Acquiring lock "cinder-quobyte-ac8aa110-f253-42cb-a724-315c2510f8d9" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:44:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Lock "cinder-quobyte-ac8aa110-f253-42cb-a724-315c2510f8d9" acquired by "delete_volume" :: waited 0.025s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:44:03 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c566a5e-2473-4ea8-8c19-f0d6fe2707ab]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:44:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ac8aa110-f253-42cb-a724-315c2510f8d9 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ac8aa110-f253-42cb-a724-315c2510f8d9" returned: 0 in 0.717s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ac8aa110-f253-42cb-a724-315c2510f8d9 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ac8aa110-f253-42cb-a724-315c2510f8d9" returned: 0 in 0.165s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Lock "cinder-quobyte-ac8aa110-f253-42cb-a724-315c2510f8d9" released by "delete_volume" :: held 1.096s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:44:04 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Created reservations ['8398ac15-760b-4958-be3e-5c2ee3639d71', '5c46cb0a-8f1f-47ec-ba50-c91808f84588', 'afd47eb4-63c5-46c6-9eac-29dfb268b7f7', 'f32da066-5877-4b45-bc4f-fa1d32f5f098'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:44:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:44:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:44:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:44:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:44:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:44:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.126s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:05 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:44:05 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Deleted volume successfully.
Sep 10 13:44:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-901ca668-560e-478e-89ee-67dd1c421d4d tempest-VolumesTransfersV355Test-364221776 None] Lock "cinder-ac8aa110-f253-42cb-a724-315c2510f8d9-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:44:15 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=18,cinder:SELECT=14,cinder:INSERT=6,cinder:DELETE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:44:15 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=12,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:44:19 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Flow 'volume_create_manager' (e2db96ef-49b9-4a51-9bc7-f3817aa799f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd91c618-f9da-4dd4-b482-ce30b1911c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd91c618-f9da-4dd4-b482-ce30b1911c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1494598967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c882df5-30ca-4efe-b5f1-efa6eb2e455d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08d7f88296e4436a9fb1c28629f41b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:44:19Z,use_quota=True,user_id='48bc6951d70f42e490810be3994c665b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2ffe37-4cfa-41a1-a7f8-bc322a66ee1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2ffe37-4cfa-41a1-a7f8-bc322a66ee1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f830a04-266a-43a9-8bcf-e251d164414f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f830a04-266a-43a9-8bcf-e251d164414f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c882df5-30ca-4efe-b5f1-efa6eb2e455d', 'volume_name': 'volume-2c882df5-30ca-4efe-b5f1-efa6eb2e455d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdba247b-0a8e-47f5-9b62-914dfdac025d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdba247b-0a8e-47f5-9b62-914dfdac025d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84159765-705e-4e24-a9f0-dd49ac616585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:19 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Volume 2c882df5-30ca-4efe-b5f1-efa6eb2e455d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c882df5-30ca-4efe-b5f1-efa6eb2e455d', 'volume_size': 1}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1494598967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c882df5-30ca-4efe-b5f1-efa6eb2e455d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08d7f88296e4436a9fb1c28629f41b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:44:19Z,use_quota=True,user_id='48bc6951d70f42e490810be3994c665b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Creating volume 2c882df5-30ca-4efe-b5f1-efa6eb2e455d {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:44:19 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:44:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2c882df5-30ca-4efe-b5f1-efa6eb2e455d 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:19 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=35, name=volume-2c882df5-30ca-4efe-b5f1-efa6eb2e455d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:44:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2c882df5-30ca-4efe-b5f1-efa6eb2e455d 1073741824" returned: 0 in 0.387s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2c882df5-30ca-4efe-b5f1-efa6eb2e455d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2c882df5-30ca-4efe-b5f1-efa6eb2e455d" returned: 0 in 0.142s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] <== create_volume: return (602ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:44:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.619s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:44:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84159765-705e-4e24-a9f0-dd49ac616585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c882df5-30ca-4efe-b5f1-efa6eb2e455d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7463428-bc20-4f22-a234-976cabc7aedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:20 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Volume volume-2c882df5-30ca-4efe-b5f1-efa6eb2e455d (2c882df5-30ca-4efe-b5f1-efa6eb2e455d): created successfully
Sep 10 13:44:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7463428-bc20-4f22-a234-976cabc7aedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Flow 'volume_create_manager' (e2db96ef-49b9-4a51-9bc7-f3817aa799f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:44:20 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a66b2f26-b5e1-4169-93fb-37eabf18e5fb tempest-VolumesTransfersV357Test-201018060 None] Created volume successfully.
Sep 10 13:44:22 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-f3bfc581-e088-44c3-ad8d-867f1021b083 tempest-VolumesTransfersV357Test-171547874 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:44:22 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f3bfc581-e088-44c3-ad8d-867f1021b083 tempest-VolumesTransfersV357Test-171547874 None] Transfer volume completed successfully.
Sep 10 13:44:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Acquiring lock "cinder-2c882df5-30ca-4efe-b5f1-efa6eb2e455d-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:44:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Lock "cinder-2c882df5-30ca-4efe-b5f1-efa6eb2e455d-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:44:23 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:44:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Acquiring lock "cinder-quobyte-2c882df5-30ca-4efe-b5f1-efa6eb2e455d" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:44:24 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Lock "cinder-quobyte-2c882df5-30ca-4efe-b5f1-efa6eb2e455d" acquired by "delete_volume" :: waited 0.031s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:44:24 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[7373bdb4-0c5b-43d8-a3ea-d01e205d4996]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:44:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2c882df5-30ca-4efe-b5f1-efa6eb2e455d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2c882df5-30ca-4efe-b5f1-efa6eb2e455d" returned: 0 in 0.689s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2c882df5-30ca-4efe-b5f1-efa6eb2e455d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2c882df5-30ca-4efe-b5f1-efa6eb2e455d" returned: 0 in 0.134s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Lock "cinder-quobyte-2c882df5-30ca-4efe-b5f1-efa6eb2e455d" released by "delete_volume" :: held 1.123s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:44:25 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Created reservations ['ff9cd10a-cf10-40c2-bcb3-e54521a06efb', '1d39f2a6-b52a-4e04-ab66-bf57aeb5d4b7', 'a07b154c-a8b7-49da-b702-0260bc93115c', 'ca3eccaf-2589-4409-b532-18a959dc68b5'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:44:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:44:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:44:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:44:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:44:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:44:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.211s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:25 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:44:26 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Deleted volume successfully.
Sep 10 13:44:26 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a68482a2-794d-49b0-8852-f9d0a67fccac tempest-VolumesTransfersV357Test-2057287267 None] Lock "cinder-2c882df5-30ca-4efe-b5f1-efa6eb2e455d-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:44:27 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:44:27 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:44:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Flow 'volume_create_manager' (b73a2a42-c85a-4962-bd25-ac850132eefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4302fe6c-9631-4db2-b9d3-061a5a229e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4302fe6c-9631-4db2-b9d3-061a5a229e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1750327805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6252bf20-2cc6-412d-bab7-0f36de901ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08d7f88296e4436a9fb1c28629f41b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:44:27Z,use_quota=True,user_id='48bc6951d70f42e490810be3994c665b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de288352-bd91-4c98-9d5b-34f39baea4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de288352-bd91-4c98-9d5b-34f39baea4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d859be-d3e1-4bd2-bb4c-19d4f3446654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d859be-d3e1-4bd2-bb4c-19d4f3446654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6252bf20-2cc6-412d-bab7-0f36de901ddf', 'volume_name': 'volume-6252bf20-2cc6-412d-bab7-0f36de901ddf', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cea2754-145b-49bd-b2f3-cf219fe4e842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cea2754-145b-49bd-b2f3-cf219fe4e842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e065e132-cf72-45cd-ac6b-04709e9531b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:28 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Volume 6252bf20-2cc6-412d-bab7-0f36de901ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6252bf20-2cc6-412d-bab7-0f36de901ddf', 'volume_size': 1}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1750327805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6252bf20-2cc6-412d-bab7-0f36de901ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08d7f88296e4436a9fb1c28629f41b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:44:27Z,use_quota=True,user_id='48bc6951d70f42e490810be3994c665b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Creating volume 6252bf20-2cc6-412d-bab7-0f36de901ddf {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.078s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:44:28 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:44:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6252bf20-2cc6-412d-bab7-0f36de901ddf 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:44:29 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=36, name=volume-6252bf20-2cc6-412d-bab7-0f36de901ddf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:44:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:44:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.080s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:44:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:44:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:44:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:44:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.532s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:44:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6252bf20-2cc6-412d-bab7-0f36de901ddf 1073741824" returned: 0 in 1.780s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6252bf20-2cc6-412d-bab7-0f36de901ddf {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6252bf20-2cc6-412d-bab7-0f36de901ddf" returned: 0 in 0.658s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] <== create_volume: return (2898ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:44:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.948s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:44:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e065e132-cf72-45cd-ac6b-04709e9531b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6252bf20-2cc6-412d-bab7-0f36de901ddf', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd30fff-6ca7-4c0e-b0c8-d3e1dc904564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:32 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Volume volume-6252bf20-2cc6-412d-bab7-0f36de901ddf (6252bf20-2cc6-412d-bab7-0f36de901ddf): created successfully
Sep 10 13:44:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd30fff-6ca7-4c0e-b0c8-d3e1dc904564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Flow 'volume_create_manager' (b73a2a42-c85a-4962-bd25-ac850132eefe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:44:32 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b12cc145-1af9-4667-a5f6-bb42373327fd tempest-VolumesTransfersV357Test-201018060 None] Created volume successfully.
Sep 10 13:44:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Acquiring lock "cinder-6252bf20-2cc6-412d-bab7-0f36de901ddf-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:44:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Lock "cinder-6252bf20-2cc6-412d-bab7-0f36de901ddf-delete_volume" acquired by "delete_volume" :: waited 0.162s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:44:34 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:44:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Acquiring lock "cinder-quobyte-6252bf20-2cc6-412d-bab7-0f36de901ddf" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:44:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Lock "cinder-quobyte-6252bf20-2cc6-412d-bab7-0f36de901ddf" acquired by "delete_volume" :: waited 0.025s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:44:34 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a22b8c-6bf3-44d8-a5db-64d5e5ab05e3]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:44:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6252bf20-2cc6-412d-bab7-0f36de901ddf {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6252bf20-2cc6-412d-bab7-0f36de901ddf" returned: 0 in 1.090s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6252bf20-2cc6-412d-bab7-0f36de901ddf {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6252bf20-2cc6-412d-bab7-0f36de901ddf" returned: 0 in 0.198s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:35 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Lock "cinder-quobyte-6252bf20-2cc6-412d-bab7-0f36de901ddf" released by "delete_volume" :: held 1.582s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:44:36 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Created reservations ['b5df5096-6d92-4922-a2e5-482bf28c065d', '0f93e9d6-4834-48ae-8d17-6852f2b23187', 'a073bfc8-7f57-473b-b46e-13f1e12dd977', 'ac20532f-a385-4b35-acf3-b6d23c99b2db'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:44:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:44:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:44:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:44:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:44:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:44:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.141s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:36 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:44:36 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Deleted volume successfully.
Sep 10 13:44:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6b3d67a6-79fa-47ac-bbb5-4d46d1390792 tempest-VolumesTransfersV357Test-2057287267 None] Lock "cinder-6252bf20-2cc6-412d-bab7-0f36de901ddf-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:44:46 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=25,cinder:SELECT=13,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:44:47 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=12,cinder:UPDATE=15,cinder:DELETE=3,cinder:INSERT=4 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:44:55 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Flow 'volume_create_manager' (76cfa337-d83a-4159-8126-7cea7fc3cfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557c522e-31fb-4622-a210-a1622f63f98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557c522e-31fb-4622-a210-a1622f63f98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-585625560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca8802c-a97a-4305-a99e-0c05013e1312,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f607ad1e8c274bc7acf859e7f89a8103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:44:55Z,use_quota=True,user_id='64a25e57854940c4889df3a7f4de081e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e236135e-273e-4bf6-bb84-a2892717f444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e236135e-273e-4bf6-bb84-a2892717f444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba898809-1e12-4ef9-b640-a343f0c2b460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba898809-1e12-4ef9-b640-a343f0c2b460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ca8802c-a97a-4305-a99e-0c05013e1312', 'volume_name': 'volume-3ca8802c-a97a-4305-a99e-0c05013e1312', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3616fc-fad3-4830-90f8-5be56c163d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3616fc-fad3-4830-90f8-5be56c163d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6cb59b-0007-473a-8836-b8d3a6bbf710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:55 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Volume 3ca8802c-a97a-4305-a99e-0c05013e1312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ca8802c-a97a-4305-a99e-0c05013e1312', 'volume_size': 1}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-585625560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca8802c-a97a-4305-a99e-0c05013e1312,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f607ad1e8c274bc7acf859e7f89a8103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:44:55Z,use_quota=True,user_id='64a25e57854940c4889df3a7f4de081e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Creating volume 3ca8802c-a97a-4305-a99e-0c05013e1312 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:44:55 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:44:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ca8802c-a97a-4305-a99e-0c05013e1312 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:55 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=37, name=volume-3ca8802c-a97a-4305-a99e-0c05013e1312, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:44:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ca8802c-a97a-4305-a99e-0c05013e1312 1073741824" returned: 0 in 0.715s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ca8802c-a97a-4305-a99e-0c05013e1312 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ca8802c-a97a-4305-a99e-0c05013e1312" returned: 0 in 0.184s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] <== create_volume: return (1068ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:44:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:44:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6cb59b-0007-473a-8836-b8d3a6bbf710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ca8802c-a97a-4305-a99e-0c05013e1312', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d168760-7f1f-4199-aacf-81cb5a1fddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:56 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Volume volume-3ca8802c-a97a-4305-a99e-0c05013e1312 (3ca8802c-a97a-4305-a99e-0c05013e1312): created successfully
Sep 10 13:44:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d168760-7f1f-4199-aacf-81cb5a1fddef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Flow 'volume_create_manager' (76cfa337-d83a-4159-8126-7cea7fc3cfb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:44:56 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-0ba999d0-e3e3-45ab-8283-c053c1fda8d4 tempest-VolumesListTestJSON-1583715106 None] Created volume successfully.
Sep 10 13:44:58 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Flow 'volume_create_manager' (ef2606b2-d5d6-4dc1-9165-71ef16bec2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe47c30-8e28-4209-bcd0-b0d5d096d6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe47c30-8e28-4209-bcd0-b0d5d096d6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-548662491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e704209-a9fe-45b9-91b6-eac645b124be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f607ad1e8c274bc7acf859e7f89a8103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:44:58Z,use_quota=True,user_id='64a25e57854940c4889df3a7f4de081e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d6ac7a-a703-462b-98e2-b98d6d6b9906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d6ac7a-a703-462b-98e2-b98d6d6b9906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce75d9f7-28d6-48af-a95d-360273c30571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce75d9f7-28d6-48af-a95d-360273c30571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e704209-a9fe-45b9-91b6-eac645b124be', 'volume_name': 'volume-2e704209-a9fe-45b9-91b6-eac645b124be', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52470bc-8ec2-4f2d-8b0b-ec03c779c1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52470bc-8ec2-4f2d-8b0b-ec03c779c1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a24e43-f615-4b80-8f2b-aced522adaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:58 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Volume 2e704209-a9fe-45b9-91b6-eac645b124be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e704209-a9fe-45b9-91b6-eac645b124be', 'volume_size': 1}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-548662491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e704209-a9fe-45b9-91b6-eac645b124be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f607ad1e8c274bc7acf859e7f89a8103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:44:58Z,use_quota=True,user_id='64a25e57854940c4889df3a7f4de081e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Creating volume 2e704209-a9fe-45b9-91b6-eac645b124be {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:44:58 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2e704209-a9fe-45b9-91b6-eac645b124be 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:58 devstack quobyte-client[82845]: System call of process 89265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:44:58 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=38, name=volume-2e704209-a9fe-45b9-91b6-eac645b124be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2e704209-a9fe-45b9-91b6-eac645b124be 1073741824" returned: 0 in 0.459s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2e704209-a9fe-45b9-91b6-eac645b124be {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2e704209-a9fe-45b9-91b6-eac645b124be" returned: 0 in 0.122s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] <== create_volume: return (655ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:44:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:44:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a24e43-f615-4b80-8f2b-aced522adaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e704209-a9fe-45b9-91b6-eac645b124be', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7394967f-de61-4d3b-abca-feadf699f716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:44:59 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Volume volume-2e704209-a9fe-45b9-91b6-eac645b124be (2e704209-a9fe-45b9-91b6-eac645b124be): created successfully
Sep 10 13:44:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7394967f-de61-4d3b-abca-feadf699f716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:44:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Flow 'volume_create_manager' (ef2606b2-d5d6-4dc1-9165-71ef16bec2b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:44:59 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b6cd73c7-bcb8-4d85-84f2-151dc934c64e tempest-VolumesListTestJSON-1583715106 None] Created volume successfully.
Sep 10 13:45:01 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:45:01 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:45:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Flow 'volume_create_manager' (fa1a7f63-35a0-42b5-b426-c0fc1ba46bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:45:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22090947-4e57-415b-b6ff-5a67c803a932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22090947-4e57-415b-b6ff-5a67c803a932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-341589324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e83f52-b4d5-4871-9f75-eafb0af9152d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f607ad1e8c274bc7acf859e7f89a8103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:45:01Z,use_quota=True,user_id='64a25e57854940c4889df3a7f4de081e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38e6e02-c9dd-460b-8b42-6007a6274417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38e6e02-c9dd-460b-8b42-6007a6274417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80b00c2-9fa3-4e69-8b81-ca3ab2a5a53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80b00c2-9fa3-4e69-8b81-ca3ab2a5a53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51e83f52-b4d5-4871-9f75-eafb0af9152d', 'volume_name': 'volume-51e83f52-b4d5-4871-9f75-eafb0af9152d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ddd3ec-0300-421e-8407-1947d4f1e665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ddd3ec-0300-421e-8407-1947d4f1e665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a600da-fe36-4123-8295-d077c9059b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:02 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Volume 51e83f52-b4d5-4871-9f75-eafb0af9152d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51e83f52-b4d5-4871-9f75-eafb0af9152d', 'volume_size': 1}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-341589324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e83f52-b4d5-4871-9f75-eafb0af9152d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f607ad1e8c274bc7acf859e7f89a8103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:45:01Z,use_quota=True,user_id='64a25e57854940c4889df3a7f4de081e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Creating volume 51e83f52-b4d5-4871-9f75-eafb0af9152d {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:45:02 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:45:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51e83f52-b4d5-4871-9f75-eafb0af9152d 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:03 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=39, name=volume-51e83f52-b4d5-4871-9f75-eafb0af9152d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:45:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51e83f52-b4d5-4871-9f75-eafb0af9152d 1073741824" returned: 0 in 1.908s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51e83f52-b4d5-4871-9f75-eafb0af9152d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51e83f52-b4d5-4871-9f75-eafb0af9152d" returned: 0 in 0.123s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:04 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] <== create_volume: return (2183ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:45:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:45:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a600da-fe36-4123-8295-d077c9059b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e83f52-b4d5-4871-9f75-eafb0af9152d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd983e8-8b17-4810-b2e8-1c8848a28764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:05 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Volume volume-51e83f52-b4d5-4871-9f75-eafb0af9152d (51e83f52-b4d5-4871-9f75-eafb0af9152d): created successfully
Sep 10 13:45:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd983e8-8b17-4810-b2e8-1c8848a28764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Flow 'volume_create_manager' (fa1a7f63-35a0-42b5-b426-c0fc1ba46bf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:45:05 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-5c02c61f-f9f0-4338-95fb-44cb7bd9d12f tempest-VolumesListTestJSON-1583715106 None] Created volume successfully.
Sep 10 13:45:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Acquiring lock "cinder-51e83f52-b4d5-4871-9f75-eafb0af9152d-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:45:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Lock "cinder-51e83f52-b4d5-4871-9f75-eafb0af9152d-delete_volume" acquired by "delete_volume" :: waited 0.151s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:45:10 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:45:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Acquiring lock "cinder-quobyte-51e83f52-b4d5-4871-9f75-eafb0af9152d" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:45:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Lock "cinder-quobyte-51e83f52-b4d5-4871-9f75-eafb0af9152d" acquired by "delete_volume" :: waited 0.016s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:45:10 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b67a4d-3f6e-41d3-9d3e-2f7380e6cb79]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:45:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51e83f52-b4d5-4871-9f75-eafb0af9152d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-29987bfb-b7a9-42df-9322-7708a23e5640 req-9cb59739-c6f8-4f5b-bdda-65e007b4bd44 tempest-TaggedAttachmentsTest-1943989061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:45:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-29987bfb-b7a9-42df-9322-7708a23e5640 req-9cb59739-c6f8-4f5b-bdda-65e007b4bd44 tempest-TaggedAttachmentsTest-1943989061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.014s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:45:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51e83f52-b4d5-4871-9f75-eafb0af9152d" returned: 0 in 0.713s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51e83f52-b4d5-4871-9f75-eafb0af9152d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:11 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b85fef6-b1e5-42a6-b343-1b347cfff4bb]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:45:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-29987bfb-b7a9-42df-9322-7708a23e5640 req-9cb59739-c6f8-4f5b-bdda-65e007b4bd44 tempest-TaggedAttachmentsTest-1943989061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dd1a8ae-2a95-4996-a005-7d05b8842210 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51e83f52-b4d5-4871-9f75-eafb0af9152d" returned: 0 in 0.380s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:11 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Lock "cinder-quobyte-51e83f52-b4d5-4871-9f75-eafb0af9152d" released by "delete_volume" :: held 1.220s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:45:12 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Created reservations ['302a52e9-2aba-4229-b84a-2e55b6eca324', '8d1c2b2b-cd94-4686-b50a-d10f5676b6dc', '4cd5c9f0-20f9-4121-8741-fc856d9b036b', 'def1edac-5280-433b-8279-64830f203fef'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:45:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-29987bfb-b7a9-42df-9322-7708a23e5640 req-9cb59739-c6f8-4f5b-bdda-65e007b4bd44 tempest-TaggedAttachmentsTest-1943989061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dd1a8ae-2a95-4996-a005-7d05b8842210" returned: 0 in 0.614s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-29987bfb-b7a9-42df-9322-7708a23e5640 req-9cb59739-c6f8-4f5b-bdda-65e007b4bd44 tempest-TaggedAttachmentsTest-1943989061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.869s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:45:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:45:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:45:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:45:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:45:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:45:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-29987bfb-b7a9-42df-9322-7708a23e5640 req-9cb59739-c6f8-4f5b-bdda-65e007b4bd44 tempest-TaggedAttachmentsTest-1943989061 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-2dd1a8ae-2a95-4996-a005-7d05b8842210', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62bac5f0-5163-43b4-b3b4-b6aa98fe1f61', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:45:12 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-29987bfb-b7a9-42df-9322-7708a23e5640 req-9cb59739-c6f8-4f5b-bdda-65e007b4bd44 tempest-TaggedAttachmentsTest-1943989061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:45:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.428s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:12 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:45:12 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Deleted volume successfully.
Sep 10 13:45:13 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-29987bfb-b7a9-42df-9322-7708a23e5640 req-9cb59739-c6f8-4f5b-bdda-65e007b4bd44 tempest-TaggedAttachmentsTest-1943989061 None] attachment_update completed successfully.
Sep 10 13:45:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-302f6895-7cfa-4651-82c0-f02630becbcb tempest-VolumesListTestJSON-1583715106 None] Lock "cinder-51e83f52-b4d5-4871-9f75-eafb0af9152d-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:45:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Acquiring lock "cinder-2e704209-a9fe-45b9-91b6-eac645b124be-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:45:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Lock "cinder-2e704209-a9fe-45b9-91b6-eac645b124be-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:45:13 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:45:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Acquiring lock "cinder-quobyte-2e704209-a9fe-45b9-91b6-eac645b124be" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:45:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Lock "cinder-quobyte-2e704209-a9fe-45b9-91b6-eac645b124be" acquired by "delete_volume" :: waited 0.024s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:45:13 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d52330-f846-4ccb-9e96-6ef2d80b3995]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:45:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2e704209-a9fe-45b9-91b6-eac645b124be {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2e704209-a9fe-45b9-91b6-eac645b124be" returned: 0 in 0.721s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2e704209-a9fe-45b9-91b6-eac645b124be {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2e704209-a9fe-45b9-91b6-eac645b124be" returned: 0 in 0.190s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Lock "cinder-quobyte-2e704209-a9fe-45b9-91b6-eac645b124be" released by "delete_volume" :: held 1.197s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:45:14 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Created reservations ['336532b9-8fe1-4b72-a297-0359fe7591e2', '5a4401e3-9a2a-497b-a348-f798315fe878', '00102323-f443-4862-9e4e-ba0cb19b7d7e', 'c2bfeb78-3b6a-4e11-8ec6-797b585ff12e'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:45:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:45:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:45:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:45:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:45:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:45:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.101s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:15 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:45:15 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Deleted volume successfully.
Sep 10 13:45:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b867b42c-a38b-435a-bdba-464d2fbae574 tempest-VolumesListTestJSON-1583715106 None] Lock "cinder-2e704209-a9fe-45b9-91b6-eac645b124be-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:45:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Acquiring lock "cinder-3ca8802c-a97a-4305-a99e-0c05013e1312-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:45:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Lock "cinder-3ca8802c-a97a-4305-a99e-0c05013e1312-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:45:15 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:45:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Acquiring lock "cinder-quobyte-3ca8802c-a97a-4305-a99e-0c05013e1312" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:45:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Lock "cinder-quobyte-3ca8802c-a97a-4305-a99e-0c05013e1312" acquired by "delete_volume" :: waited 0.014s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:45:15 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b21ba0-5e5a-42e7-bc5d-3fd4379fcef8]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:45:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ca8802c-a97a-4305-a99e-0c05013e1312 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ca8802c-a97a-4305-a99e-0c05013e1312" returned: 0 in 0.579s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ca8802c-a97a-4305-a99e-0c05013e1312 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ca8802c-a97a-4305-a99e-0c05013e1312" returned: 0 in 0.218s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:16 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Lock "cinder-quobyte-3ca8802c-a97a-4305-a99e-0c05013e1312" released by "delete_volume" :: held 0.983s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:45:17 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Created reservations ['0536374d-c440-4c53-b33d-0cc8514f9ffa', 'f438d722-ed91-4498-bbb0-4b268b08d7b2', 'ee10c0b5-a828-4bbd-b12e-552854be41f8', '57bf0cb9-e02e-414b-a5ab-52de517191dd'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:45:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:45:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:45:17 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:45:17 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:45:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:45:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.148s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:17 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:45:17 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Deleted volume successfully.
Sep 10 13:45:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7065e5d1-63c3-4eb4-86a1-3420040106a2 tempest-VolumesListTestJSON-1583715106 None] Lock "cinder-3ca8802c-a97a-4305-a99e-0c05013e1312-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:45:27 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=35,cinder:SELECT=21,cinder:INSERT=7,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:45:27 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=26,cinder:UPDATE=28,cinder:DELETE=5,cinder:INSERT=5 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:45:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:45:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:45:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:45:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:45:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:45:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:45:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.266s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:45:45 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-08a34b36-37c3-48ad-a593-d5e30932b62a req-38c4e5d3-8d38-42f7-a86e-f3250c598fe5 tempest-TaggedAttachmentsTest-1943989061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:45:45 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-08a34b36-37c3-48ad-a593-d5e30932b62a req-38c4e5d3-8d38-42f7-a86e-f3250c598fe5 tempest-TaggedAttachmentsTest-1943989061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:45:45 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-08a34b36-37c3-48ad-a593-d5e30932b62a req-38c4e5d3-8d38-42f7-a86e-f3250c598fe5 tempest-TaggedAttachmentsTest-1943989061 None] Terminate volume connection completed successfully.
Sep 10 13:45:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-08a34b36-37c3-48ad-a593-d5e30932b62a req-38c4e5d3-8d38-42f7-a86e-f3250c598fe5 tempest-TaggedAttachmentsTest-1943989061 None] Deleting attachment 62bac5f0-5163-43b4-b3b4-b6aa98fe1f61. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:45:51 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:45:51 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Flow 'volume_create_manager' (4013bc37-44f5-49bf-af41-479af7cba2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5bce566-08a9-4c98-91d8-884075eadbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5bce566-08a9-4c98-91d8-884075eadbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-353410164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65dbfbf3-d42d-47c1-aeb3-b7de9369d962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42cf01748de843fdb809b5c0870dd0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:45:52Z,use_quota=True,user_id='b1347bbd92ca44bf91859cb80c1238b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5efc96d-6435-47b1-8b25-924a6d3aa85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5efc96d-6435-47b1-8b25-924a6d3aa85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd45fe8-bb36-4155-ae5f-cd255af5c78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd45fe8-bb36-4155-ae5f-cd255af5c78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65dbfbf3-d42d-47c1-aeb3-b7de9369d962', 'volume_name': 'volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aef18d5-7053-46a5-881a-e734445a9e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aef18d5-7053-46a5-881a-e734445a9e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d55668-71c9-40c1-a017-87f5f50efcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:52 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Volume 65dbfbf3-d42d-47c1-aeb3-b7de9369d962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962', 'volume_size': 1}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-353410164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65dbfbf3-d42d-47c1-aeb3-b7de9369d962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42cf01748de843fdb809b5c0870dd0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:45:52Z,use_quota=True,user_id='b1347bbd92ca44bf91859cb80c1238b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Creating volume 65dbfbf3-d42d-47c1-aeb3-b7de9369d962 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:45:52 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:52 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=40, name=volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962 1073741824" returned: 0 in 0.503s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962" returned: 0 in 0.142s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] <== create_volume: return (718ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:45:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:45:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d55668-71c9-40c1-a017-87f5f50efcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b207b0-547d-4d9d-8025-f15973cfdbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:53 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Volume volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962 (65dbfbf3-d42d-47c1-aeb3-b7de9369d962): created successfully
Sep 10 13:45:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b207b0-547d-4d9d-8025-f15973cfdbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Flow 'volume_create_manager' (4013bc37-44f5-49bf-af41-479af7cba2f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:45:53 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-392ff4cf-2a37-41d9-b186-56ac8e32ebba tempest-AttachVolumeTestJSON-1032577895 None] Created volume successfully.
Sep 10 13:45:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-723b1d17-cae6-4552-9cc2-3f244e181407 req-2b981c13-9923-4c34-8070-2857002bf8ab tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:45:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-723b1d17-cae6-4552-9cc2-3f244e181407 req-2b981c13-9923-4c34-8070-2857002bf8ab tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:45:57 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ea2a78-7fac-4d3f-a62c-0b49249e8021]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:45:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-723b1d17-cae6-4552-9cc2-3f244e181407 req-2b981c13-9923-4c34-8070-2857002bf8ab tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-723b1d17-cae6-4552-9cc2-3f244e181407 req-2b981c13-9923-4c34-8070-2857002bf8ab tempest-AttachVolumeTestJSON-1032577895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962" returned: 0 in 0.461s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-723b1d17-cae6-4552-9cc2-3f244e181407 req-2b981c13-9923-4c34-8070-2857002bf8ab tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.530s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-723b1d17-cae6-4552-9cc2-3f244e181407 req-2b981c13-9923-4c34-8070-2857002bf8ab tempest-AttachVolumeTestJSON-1032577895 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0138469-930c-4547-b3a6-f8f39c8723c3', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:45:58 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-723b1d17-cae6-4552-9cc2-3f244e181407 req-2b981c13-9923-4c34-8070-2857002bf8ab tempest-AttachVolumeTestJSON-1032577895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:45:58 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Flow 'volume_create_manager' (4d55d406-5738-4b40-a07e-fea96673d1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6a9870-0af4-47fe-9c67-5457265ae1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6a9870-0af4-47fe-9c67-5457265ae1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-960175252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5321df85-0794-402b-81b1-4b4f20fc310c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee44aad772f4382bbc4a79c2786028d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:45:58Z,use_quota=True,user_id='385c1dd7df8b4ce1a519f871e400a051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0d27e53-a27b-40e2-9c72-8712ef7b4d99),volume_type_id=e0d27e53-a27b-40e2-9c72-8712ef7b4d99)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ead65fc-5b83-4929-88b4-45f49cc9a655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ead65fc-5b83-4929-88b4-45f49cc9a655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ef35bb-f960-4b31-81eb-4d13ebc14565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ef35bb-f960-4b31-81eb-4d13ebc14565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5321df85-0794-402b-81b1-4b4f20fc310c', 'volume_name': 'volume-5321df85-0794-402b-81b1-4b4f20fc310c', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140b5da8-cc16-40b5-88b9-22594afc364d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140b5da8-cc16-40b5-88b9-22594afc364d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c03701-9551-4c67-9870-05f0ee730c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:58 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Volume 5321df85-0794-402b-81b1-4b4f20fc310c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5321df85-0794-402b-81b1-4b4f20fc310c', 'volume_size': 1}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-960175252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5321df85-0794-402b-81b1-4b4f20fc310c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee44aad772f4382bbc4a79c2786028d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:45:58Z,use_quota=True,user_id='385c1dd7df8b4ce1a519f871e400a051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0d27e53-a27b-40e2-9c72-8712ef7b4d99),volume_type_id=e0d27e53-a27b-40e2-9c72-8712ef7b4d99)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Creating volume 5321df85-0794-402b-81b1-4b4f20fc310c {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:45:58 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:45:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5321df85-0794-402b-81b1-4b4f20fc310c 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:58 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=41, name=volume-5321df85-0794-402b-81b1-4b4f20fc310c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5321df85-0794-402b-81b1-4b4f20fc310c 1073741824" returned: 0 in 0.637s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5321df85-0794-402b-81b1-4b4f20fc310c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:45:59 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Flow 'volume_create_manager' (90e60ec7-50ab-49bc-9c02-fe511e9d4aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ee7fa4-488c-4b79-9fe0-59def7c61ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5321df85-0794-402b-81b1-4b4f20fc310c" returned: 0 in 0.485s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] <== create_volume: return (1169ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ee7fa4-488c-4b79-9fe0-59def7c61ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1628030378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12cb7059-e21f-4456-bca8-5a1e52857411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee44aad772f4382bbc4a79c2786028d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:45:59Z,use_quota=True,user_id='385c1dd7df8b4ce1a519f871e400a051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0660c8f1-e75d-4560-821e-b2b71e58058e),volume_type_id=0660c8f1-e75d-4560-821e-b2b71e58058e)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859a6b7b-c906-4b9b-ad7b-9bf25705439d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859a6b7b-c906-4b9b-ad7b-9bf25705439d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5096b56d-7d17-49ab-9b71-b54bad9e4a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5096b56d-7d17-49ab-9b71-b54bad9e4a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12cb7059-e21f-4456-bca8-5a1e52857411', 'volume_name': 'volume-12cb7059-e21f-4456-bca8-5a1e52857411', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e81e4d-e196-4096-907e-b2534c9ef7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e81e4d-e196-4096-907e-b2534c9ef7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788d24f3-6d96-41c9-9cf6-d9a1dbe07b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:45:59 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Volume 12cb7059-e21f-4456-bca8-5a1e52857411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12cb7059-e21f-4456-bca8-5a1e52857411', 'volume_size': 1}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1628030378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12cb7059-e21f-4456-bca8-5a1e52857411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee44aad772f4382bbc4a79c2786028d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:45:59Z,use_quota=True,user_id='385c1dd7df8b4ce1a519f871e400a051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0660c8f1-e75d-4560-821e-b2b71e58058e),volume_type_id=0660c8f1-e75d-4560-821e-b2b71e58058e)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Creating volume 12cb7059-e21f-4456-bca8-5a1e52857411 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:45:59 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:45:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-12cb7059-e21f-4456-bca8-5a1e52857411 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:00 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=42, name=volume-12cb7059-e21f-4456-bca8-5a1e52857411, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:46:00 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-723b1d17-cae6-4552-9cc2-3f244e181407 req-2b981c13-9923-4c34-8070-2857002bf8ab tempest-AttachVolumeTestJSON-1032577895 None] attachment_update completed successfully.
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c03701-9551-4c67-9870-05f0ee730c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5321df85-0794-402b-81b1-4b4f20fc310c', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93fe996-45d4-4a9d-9640-5bdd032793a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-12cb7059-e21f-4456-bca8-5a1e52857411 1073741824" returned: 0 in 0.463s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-12cb7059-e21f-4456-bca8-5a1e52857411 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:00 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Volume volume-5321df85-0794-402b-81b1-4b4f20fc310c (5321df85-0794-402b-81b1-4b4f20fc310c): created successfully
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93fe996-45d4-4a9d-9640-5bdd032793a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Flow 'volume_create_manager' (4d55d406-5738-4b40-a07e-fea96673d1a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:46:00 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Flow 'volume_create_manager' (fd60b985-9c8a-4324-b2ef-2d43fc04c127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1e8add-b31c-4abd-b098-b8196d4df902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1e8add-b31c-4abd-b098-b8196d4df902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-159100404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbed8312-e656-420f-bbf9-d5ac05f80ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee44aad772f4382bbc4a79c2786028d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:46:00Z,use_quota=True,user_id='385c1dd7df8b4ce1a519f871e400a051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b262e57c-061c-4542-b7c2-2009f79585cb),volume_type_id=b262e57c-061c-4542-b7c2-2009f79585cb)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38c8dae-3c90-4902-b9bf-42ac3a1320f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38c8dae-3c90-4902-b9bf-42ac3a1320f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fbfabd-ad15-4858-ae78-79a63e2104b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-12cb7059-e21f-4456-bca8-5a1e52857411" returned: 0 in 0.609s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] <== create_volume: return (1092ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:46:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:46:00 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-dd0cc9cb-aaf0-4614-a1e0-5d707f246f79 tempest-TestInstancesWithCinderVolumes-602423865 None] Created volume successfully.
Sep 10 13:46:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788d24f3-6d96-41c9-9cf6-d9a1dbe07b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12cb7059-e21f-4456-bca8-5a1e52857411', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26b98e4-e448-4348-98ff-67cc61b667e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:46:01 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Volume volume-12cb7059-e21f-4456-bca8-5a1e52857411 (12cb7059-e21f-4456-bca8-5a1e52857411): created successfully
Sep 10 13:46:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26b98e4-e448-4348-98ff-67cc61b667e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Flow 'volume_create_manager' (90e60ec7-50ab-49bc-9c02-fe511e9d4aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:46:01 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-d1b10e09-3961-4a9a-b3de-f749d8f7d76a tempest-TestInstancesWithCinderVolumes-602423865 None] Created volume successfully.
Sep 10 13:46:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fbfabd-ad15-4858-ae78-79a63e2104b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bbed8312-e656-420f-bbf9-d5ac05f80ad2', 'volume_name': 'volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2', 'volume_size': 1, 'image_id': '4ecd7ebd-58d4-4573-aa84-c9132b63ad77', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--1021766953', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fee44aad772f4382bbc4a79c2786028d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ecd7ebd-58d4-4573-aa84-c9132b63ad77', 'created_at': datetime.datetime(2025, 9, 10, 11, 45, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 45, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ecd7ebd-58d4-4573-aa84-c9132b63ad77/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b5d462f0>}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409ff29d-dbeb-4adf-84f4-53106b99f302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:46:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409ff29d-dbeb-4adf-84f4-53106b99f302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d64db6-a120-458f-a6ef-d1849e922886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:46:01 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Volume bbed8312-e656-420f-bbf9-d5ac05f80ad2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2', 'volume_size': 1, 'image_id': '4ecd7ebd-58d4-4573-aa84-c9132b63ad77', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--1021766953', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fee44aad772f4382bbc4a79c2786028d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ecd7ebd-58d4-4573-aa84-c9132b63ad77', 'created_at': datetime.datetime(2025, 9, 10, 11, 45, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 45, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ecd7ebd-58d4-4573-aa84-c9132b63ad77/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b5d462f0>}
Sep 10 13:46:01 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Cloning bbed8312-e656-420f-bbf9-d5ac05f80ad2 from image 4ecd7ebd-58d4-4573-aa84-c9132b63ad77  at location (None, None). {{(pid=82823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 13:46:03 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_bl37xf5fdevstack@QuobyteHD, size 20.69 MB, duration 1.89 sec {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 13:46:03 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Image download 20.69 MB at 10.93 MB/s
Sep 10 13:46:03 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[72755171-27c0-420c-b07b-c9b0360aea96]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:46:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_bl37xf5fdevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:03 devstack sudo[90337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_bl37xf5fdevstack@QuobyteHD
Sep 10 13:46:03 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:46:05 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root
Sep 10 13:46:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_bl37xf5fdevstack@QuobyteHD" returned: 0 in 2.078s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:05 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Temporary image 4ecd7ebd-58d4-4573-aa84-c9132b63ad77 is fetched for user 385c1dd7df8b4ce1a519f871e400a051. {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 13:46:05 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b1a885-935d-4c64-b4c6-ea2554b641a0]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:46:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_bl37xf5fdevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:05 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_bl37xf5fdevstack@QuobyteHD
Sep 10 13:46:05 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 13:46:07 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Flow 'volume_create_manager' (72a58370-6a93-42e7-b95e-d140a1a026ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf97008-9ff6-41ab-93f7-bd436cf4cfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:46:07 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf97008-9ff6-41ab-93f7-bd436cf4cfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1389864839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1678bf15-cce8-4248-90e0-2428e6407748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42cf01748de843fdb809b5c0870dd0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:46:07Z,use_quota=True,user_id='b1347bbd92ca44bf91859cb80c1238b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3116d75a-c3ca-4e55-9a2c-645cc38c85c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3116d75a-c3ca-4e55-9a2c-645cc38c85c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d9b485-62d6-484c-a9de-d96f0065deaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d9b485-62d6-484c-a9de-d96f0065deaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1678bf15-cce8-4248-90e0-2428e6407748', 'volume_name': 'volume-1678bf15-cce8-4248-90e0-2428e6407748', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a000bd-d578-425c-81e8-b46a340d081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a000bd-d578-425c-81e8-b46a340d081e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11f187a-b86b-4173-b2d4-d3fa7d53d608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:46:07 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Volume 1678bf15-cce8-4248-90e0-2428e6407748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1678bf15-cce8-4248-90e0-2428e6407748', 'volume_size': 1}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1389864839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1678bf15-cce8-4248-90e0-2428e6407748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42cf01748de843fdb809b5c0870dd0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:46:07Z,use_quota=True,user_id='b1347bbd92ca44bf91859cb80c1238b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Creating volume 1678bf15-cce8-4248-90e0-2428e6407748 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:46:07 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:46:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1678bf15-cce8-4248-90e0-2428e6407748 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_bl37xf5fdevstack@QuobyteHD" returned: 0 in 2.410s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:08 devstack quobyte-client[82845]: System call of process 90347 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:46:08 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=43, name=volume-1678bf15-cce8-4248-90e0-2428e6407748, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1678bf15-cce8-4248-90e0-2428e6407748 1073741824" returned: 0 in 0.357s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1678bf15-cce8-4248-90e0-2428e6407748 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1678bf15-cce8-4248-90e0-2428e6407748" returned: 0 in 0.097s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] <== create_volume: return (506ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.530s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.559s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-159100404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbed8312-e656-420f-bbf9-d5ac05f80ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee44aad772f4382bbc4a79c2786028d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:46:00Z,use_quota=True,user_id='385c1dd7df8b4ce1a519f871e400a051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b262e57c-061c-4542-b7c2-2009f79585cb),volume_type_id=b262e57c-061c-4542-b7c2-2009f79585cb)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Creating volume bbed8312-e656-420f-bbf9-d5ac05f80ad2 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:46:08 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:08 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=44, name=volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11f187a-b86b-4173-b2d4-d3fa7d53d608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1678bf15-cce8-4248-90e0-2428e6407748', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2cab34-00ec-427d-967f-e3587b74e91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:46:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2 1073741824" returned: 0 in 0.643s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:09 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Volume volume-1678bf15-cce8-4248-90e0-2428e6407748 (1678bf15-cce8-4248-90e0-2428e6407748): created successfully
Sep 10 13:46:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2cab34-00ec-427d-967f-e3587b74e91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Flow 'volume_create_manager' (72a58370-6a93-42e7-b95e-d140a1a026ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:46:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2" returned: 0 in 0.331s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:09 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] <== create_volume: return (1006ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:46:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:46:09 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b0829107-72e4-468c-9bd2-96d40388aac0 tempest-AttachVolumeTestJSON-1032577895 None] Created volume successfully.
Sep 10 13:46:09 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Attempting download of 4ecd7ebd-58d4-4573-aa84-c9132b63ad77 ((None, None)) to volume bbed8312-e656-420f-bbf9-d5ac05f80ad2. {{(pid=82823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 13:46:09 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[174cd6dd-5e77-4e05-a206-a9661dec26e3]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:46:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_dhb8vcx3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_dhb8vcx3" returned: 0 in 0.583s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_dhb8vcx3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_dhb8vcx3" returned: 1 in 0.360s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_dhb8vcx3' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 13:46:10 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab42e49-116c-429b-b09a-60944984187d]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:46:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_bl37xf5fdevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_bl37xf5fdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:11 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] 4ecd7ebd-58d4-4573-aa84-c9132b63ad77 was qcow2, converting to raw {{(pid=82823) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 13:46:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_bl37xf5fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:11 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=44, name=volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:46:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_bl37xf5fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2" returned: 0 in 1.357s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:12 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ecd7ebd-58d4-4573-aa84-c9132b63ad77_bl37xf5fdevstack@QuobyteHD, size 112.00 MB, duration 1.38 sec, destination /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2 {{(pid=82823) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 13:46:12 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Converted 112.00 MB image at 81.20 MB/s
Sep 10 13:46:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:12 devstack quobyte-client[82845]: System call of process 90376 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:46:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2 1G" returned: 0 in 0.197s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:13 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[f788e474-c015-4346-972d-c15dff84d7b5]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:46:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:13 devstack quobyte-client[82845]: System call of process 90379 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:46:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2" returned: 0 in 0.483s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2" returned: 1 in 0.825s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 13:46:14 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Downloaded image 4ecd7ebd-58d4-4573-aa84-c9132b63ad77 ((None, None)) to volume bbed8312-e656-420f-bbf9-d5ac05f80ad2 successfully. {{(pid=82823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 13:46:14 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Temporary image 4ecd7ebd-58d4-4573-aa84-c9132b63ad77 for user 385c1dd7df8b4ce1a519f871e400a051 is deleted. {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 13:46:14 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Marking volume bbed8312-e656-420f-bbf9-d5ac05f80ad2 as bootable. {{(pid=82823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 13:46:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-dcbdb2a4-226a-4494-93d2-11b269890bec req-a9624839-3c17-445e-9a92-30bc9b90b9b4 tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:46:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-dcbdb2a4-226a-4494-93d2-11b269890bec req-a9624839-3c17-445e-9a92-30bc9b90b9b4 tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:46:14 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Copying metadata from image 4ecd7ebd-58d4-4573-aa84-c9132b63ad77 to bbed8312-e656-420f-bbf9-d5ac05f80ad2. {{(pid=82823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 13:46:14 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Creating volume glance metadata for volume bbed8312-e656-420f-bbf9-d5ac05f80ad2 backed by image 4ecd7ebd-58d4-4573-aa84-c9132b63ad77 with: {'image_id': '4ecd7ebd-58d4-4573-aa84-c9132b63ad77', 'image_name': 'tempest-scenario-img--1021766953', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 13:46:14 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07f7e1f-ba54-43f4-9ddb-451c2a9ec5c2]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:46:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-dcbdb2a4-226a-4494-93d2-11b269890bec req-a9624839-3c17-445e-9a92-30bc9b90b9b4 tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1678bf15-cce8-4248-90e0-2428e6407748 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d64db6-a120-458f-a6ef-d1849e922886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2', 'volume_size': 1, 'image_id': '4ecd7ebd-58d4-4573-aa84-c9132b63ad77', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--1021766953', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fee44aad772f4382bbc4a79c2786028d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ecd7ebd-58d4-4573-aa84-c9132b63ad77', 'created_at': datetime.datetime(2025, 9, 10, 11, 45, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 45, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ecd7ebd-58d4-4573-aa84-c9132b63ad77/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b5d462f0>}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bc4d37-da89-40bb-802c-aba93e1b517c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:46:15 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Volume volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2 (bbed8312-e656-420f-bbf9-d5ac05f80ad2): created successfully
Sep 10 13:46:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bc4d37-da89-40bb-802c-aba93e1b517c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:46:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Flow 'volume_create_manager' (fd60b985-9c8a-4324-b2ef-2d43fc04c127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:46:15 devstack quobyte-client[82845]: System call of process 90392 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:46:15 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f0136303-e069-4e8c-8970-56df5f387e4d tempest-TestInstancesWithCinderVolumes-602423865 None] Created volume successfully.
Sep 10 13:46:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-dcbdb2a4-226a-4494-93d2-11b269890bec req-a9624839-3c17-445e-9a92-30bc9b90b9b4 tempest-AttachVolumeTestJSON-1032577895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1678bf15-cce8-4248-90e0-2428e6407748" returned: 0 in 0.610s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-dcbdb2a4-226a-4494-93d2-11b269890bec req-a9624839-3c17-445e-9a92-30bc9b90b9b4 tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.660s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:46:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-dcbdb2a4-226a-4494-93d2-11b269890bec req-a9624839-3c17-445e-9a92-30bc9b90b9b4 tempest-AttachVolumeTestJSON-1032577895 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-1678bf15-cce8-4248-90e0-2428e6407748', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7236658-17f0-4651-939b-a53ffa6303e3', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:46:15 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-dcbdb2a4-226a-4494-93d2-11b269890bec req-a9624839-3c17-445e-9a92-30bc9b90b9b4 tempest-AttachVolumeTestJSON-1032577895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:46:15 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-dcbdb2a4-226a-4494-93d2-11b269890bec req-a9624839-3c17-445e-9a92-30bc9b90b9b4 tempest-AttachVolumeTestJSON-1032577895 None] attachment_update completed successfully.
Sep 10 13:46:25 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=21,cinder:UPDATE=13,cinder:DELETE=4,cinder:INSERT=5 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:46:25 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=25,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:46:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-f9fefe81-93f9-4f2a-9b3c-c8e6c594f86e req-c1a67939-9095-447e-8fa1-9d7c04879ca9 tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:46:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-f9fefe81-93f9-4f2a-9b3c-c8e6c594f86e req-c1a67939-9095-447e-8fa1-9d7c04879ca9 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:46:26 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[6382d8aa-7f0b-41df-bf12-f40668db7716]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:46:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-f9fefe81-93f9-4f2a-9b3c-c8e6c594f86e req-c1a67939-9095-447e-8fa1-9d7c04879ca9 tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-f9fefe81-93f9-4f2a-9b3c-c8e6c594f86e req-c1a67939-9095-447e-8fa1-9d7c04879ca9 tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2" returned: 0 in 0.585s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-f9fefe81-93f9-4f2a-9b3c-c8e6c594f86e req-c1a67939-9095-447e-8fa1-9d7c04879ca9 tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-f9fefe81-93f9-4f2a-9b3c-c8e6c594f86e req-c1a67939-9095-447e-8fa1-9d7c04879ca9 tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2" returned: 1 in 0.750s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-f9fefe81-93f9-4f2a-9b3c-c8e6c594f86e req-c1a67939-9095-447e-8fa1-9d7c04879ca9 tempest-TestInstancesWithCinderVolumes-602423865 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 13:46:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-f9fefe81-93f9-4f2a-9b3c-c8e6c594f86e req-c1a67939-9095-447e-8fa1-9d7c04879ca9 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.634s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:46:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-f9fefe81-93f9-4f2a-9b3c-c8e6c594f86e req-c1a67939-9095-447e-8fa1-9d7c04879ca9 tempest-TestInstancesWithCinderVolumes-602423865 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '630f513c-23bc-4935-ba40-2e694db64c6c', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:46:28 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-f9fefe81-93f9-4f2a-9b3c-c8e6c594f86e req-c1a67939-9095-447e-8fa1-9d7c04879ca9 tempest-TestInstancesWithCinderVolumes-602423865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:46:28 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-f9fefe81-93f9-4f2a-9b3c-c8e6c594f86e req-c1a67939-9095-447e-8fa1-9d7c04879ca9 tempest-TestInstancesWithCinderVolumes-602423865 None] attachment_update completed successfully.
Sep 10 13:46:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:46:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:46:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:46:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:46:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:46:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:46:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.268s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:46:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Acquiring lock "cinder-2dd1a8ae-2a95-4996-a005-7d05b8842210-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:46:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Lock "cinder-2dd1a8ae-2a95-4996-a005-7d05b8842210-delete_volume" acquired by "delete_volume" :: waited 0.141s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:46:30 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:46:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Acquiring lock "cinder-quobyte-2dd1a8ae-2a95-4996-a005-7d05b8842210" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:46:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Lock "cinder-quobyte-2dd1a8ae-2a95-4996-a005-7d05b8842210" acquired by "delete_volume" :: waited 0.026s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:46:30 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b45e62-6dff-43ef-9a80-2d5491b2c0da]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:46:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dd1a8ae-2a95-4996-a005-7d05b8842210 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dd1a8ae-2a95-4996-a005-7d05b8842210" returned: 0 in 0.519s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dd1a8ae-2a95-4996-a005-7d05b8842210 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dd1a8ae-2a95-4996-a005-7d05b8842210" returned: 0 in 0.098s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Lock "cinder-quobyte-2dd1a8ae-2a95-4996-a005-7d05b8842210" released by "delete_volume" :: held 0.801s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:46:32 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Created reservations ['0fa6aea2-f1bb-40c9-a393-97a5b5f3b269', '79bdcacc-fcf4-4fe7-bb73-ff6777d38642', 'd4667e35-a052-434c-9c0a-d62ee10408c2', 'aa703136-d241-468e-b6a5-e8053007f5d5'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:46:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:46:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:46:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:46:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:46:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:46:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:46:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.084s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:46:32 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:46:32 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Deleted volume successfully.
Sep 10 13:46:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-029274fb-174e-45e6-9f44-0ad6c50c4967 tempest-TaggedAttachmentsTest-1943989061 None] Lock "cinder-2dd1a8ae-2a95-4996-a005-7d05b8842210-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:46:42 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2,cinder:INSERT=4 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:46:42 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:46:44 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-4f0dd287-b3f0-445c-9001-de392618e6aa req-0cca7a3e-6877-46e0-ac5a-46269724b0d3 tempest-AttachVolumeTestJSON-1032577895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:46:44 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-4f0dd287-b3f0-445c-9001-de392618e6aa req-0cca7a3e-6877-46e0-ac5a-46269724b0d3 tempest-AttachVolumeTestJSON-1032577895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:46:44 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-4f0dd287-b3f0-445c-9001-de392618e6aa req-0cca7a3e-6877-46e0-ac5a-46269724b0d3 tempest-AttachVolumeTestJSON-1032577895 None] Terminate volume connection completed successfully.
Sep 10 13:46:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-4f0dd287-b3f0-445c-9001-de392618e6aa req-0cca7a3e-6877-46e0-ac5a-46269724b0d3 tempest-AttachVolumeTestJSON-1032577895 None] Deleting attachment f0138469-930c-4547-b3a6-f8f39c8723c3. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:46:54 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:46:54 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:47:09 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-29ba26e5-aaf5-4e6a-b908-8c11cad30bd2 req-8568d923-53f7-4d08-91ec-a07f558a790b tempest-AttachVolumeTestJSON-1032577895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:47:10 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-29ba26e5-aaf5-4e6a-b908-8c11cad30bd2 req-8568d923-53f7-4d08-91ec-a07f558a790b tempest-AttachVolumeTestJSON-1032577895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:47:10 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-29ba26e5-aaf5-4e6a-b908-8c11cad30bd2 req-8568d923-53f7-4d08-91ec-a07f558a790b tempest-AttachVolumeTestJSON-1032577895 None] Terminate volume connection completed successfully.
Sep 10 13:47:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-29ba26e5-aaf5-4e6a-b908-8c11cad30bd2 req-8568d923-53f7-4d08-91ec-a07f558a790b tempest-AttachVolumeTestJSON-1032577895 None] Deleting attachment c7236658-17f0-4651-939b-a53ffa6303e3. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:47:20 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:47:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "cinder-1678bf15-cce8-4248-90e0-2428e6407748-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:47:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Lock "cinder-1678bf15-cce8-4248-90e0-2428e6407748-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:47:25 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:47:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "cinder-quobyte-1678bf15-cce8-4248-90e0-2428e6407748" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:47:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Lock "cinder-quobyte-1678bf15-cce8-4248-90e0-2428e6407748" acquired by "delete_volume" :: waited 0.014s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:47:25 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee0b8d4-75ca-4911-9ed5-9b9efa5fe8ee]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:47:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1678bf15-cce8-4248-90e0-2428e6407748 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:47:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1678bf15-cce8-4248-90e0-2428e6407748" returned: 0 in 0.514s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:47:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1678bf15-cce8-4248-90e0-2428e6407748 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:47:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-1678bf15-cce8-4248-90e0-2428e6407748" returned: 0 in 0.100s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:47:26 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Lock "cinder-quobyte-1678bf15-cce8-4248-90e0-2428e6407748" released by "delete_volume" :: held 0.801s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:47:26 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Created reservations ['c73c88ce-8503-4082-9633-f199793da873', 'a28a1e9e-32b6-4e84-a4d0-e1f25d8a0866', '80030775-1bbf-4418-97c3-23280354ad89', '78c7e84b-35bb-4da1-82d3-bf8614164b86'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:47:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:47:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:47:26 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:47:26 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:47:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:47:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:47:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.082s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:47:26 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:47:26 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Deleted volume successfully.
Sep 10 13:47:26 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-13ae4fa5-5128-44d2-b42e-ec427747a702 tempest-AttachVolumeTestJSON-1032577895 None] Lock "cinder-1678bf15-cce8-4248-90e0-2428e6407748-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:47:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "cinder-65dbfbf3-d42d-47c1-aeb3-b7de9369d962-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:47:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Lock "cinder-65dbfbf3-d42d-47c1-aeb3-b7de9369d962-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:47:27 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:47:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "cinder-quobyte-65dbfbf3-d42d-47c1-aeb3-b7de9369d962" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:47:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Lock "cinder-quobyte-65dbfbf3-d42d-47c1-aeb3-b7de9369d962" acquired by "delete_volume" :: waited 0.023s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:47:27 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c16e4ce-8ba3-48f8-95e7-7165b07c6460]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:47:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:47:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962" returned: 0 in 0.427s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:47:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:47:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65dbfbf3-d42d-47c1-aeb3-b7de9369d962" returned: 0 in 0.139s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:47:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Lock "cinder-quobyte-65dbfbf3-d42d-47c1-aeb3-b7de9369d962" released by "delete_volume" :: held 0.753s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:47:28 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Created reservations ['9354daf4-f86f-430e-915c-b70aa4317f80', 'b57747df-c4bd-4fbf-b2ec-fd1100af31d7', '5f2e6522-c2ad-408f-9f4e-968c247762ce', 'baeeb55d-a9bf-4731-b203-1d4797df41ae'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:47:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:47:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:47:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:47:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:47:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:47:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:47:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.093s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:47:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:47:29 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Deleted volume successfully.
Sep 10 13:47:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:47:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:47:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:47:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:47:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:47:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:47:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:47:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c26147de-7871-4376-9d82-66e84bf4d7cd tempest-AttachVolumeTestJSON-1032577895 None] Lock "cinder-65dbfbf3-d42d-47c1-aeb3-b7de9369d962-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:47:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.302s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:47:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:47:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "cinder-3667987a-6852-4b90-93a9-7882389ff584-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:47:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Lock "cinder-3667987a-6852-4b90-93a9-7882389ff584-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:47:30 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:47:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "cinder-quobyte-3667987a-6852-4b90-93a9-7882389ff584" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:47:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Lock "cinder-quobyte-3667987a-6852-4b90-93a9-7882389ff584" acquired by "delete_volume" :: waited 0.028s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:47:30 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee1d42a-74c4-4d08-a074-ef9a7b039f81]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:47:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3667987a-6852-4b90-93a9-7882389ff584 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:47:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3667987a-6852-4b90-93a9-7882389ff584" returned: 0 in 1.251s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:47:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3667987a-6852-4b90-93a9-7882389ff584 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:47:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3667987a-6852-4b90-93a9-7882389ff584" returned: 0 in 0.221s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:47:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Lock "cinder-quobyte-3667987a-6852-4b90-93a9-7882389ff584" released by "delete_volume" :: held 1.819s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:47:33 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Created reservations ['d17d7a64-f6f4-4456-abee-c60c922872a4', 'f56f7cdc-8325-4e02-99b9-1bedfa356fcb', '6f055501-b971-4dc6-80c3-b689db4e800f', 'a9eac53b-48b1-4b21-b9f8-a26fb5bbbf0e'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:47:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:47:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:47:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:47:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:47:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:47:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:47:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.344s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:47:34 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:47:34 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Deleted volume successfully.
Sep 10 13:47:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-12635f15-88d8-4997-9323-51801410f70b tempest-AttachVolumeTestJSON-1032577895 None] Lock "cinder-3667987a-6852-4b90-93a9-7882389ff584-delete_volume" released by "delete_volume" :: held 4.265s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:47:43 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=28,cinder:SELECT=14,cinder:INSERT=5,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:47:44 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=16,cinder:INSERT=7,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:47:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-f3a4e4d7-b89c-41d1-9559-952969c53a4d req-33fa2e78-880f-4cbe-ab99-18280bbb945a tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:47:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-f3a4e4d7-b89c-41d1-9559-952969c53a4d req-33fa2e78-880f-4cbe-ab99-18280bbb945a tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:47:57 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[b295db19-c3f7-40af-af90-88d946a77ba8]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:47:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-f3a4e4d7-b89c-41d1-9559-952969c53a4d req-33fa2e78-880f-4cbe-ab99-18280bbb945a tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5321df85-0794-402b-81b1-4b4f20fc310c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:47:59 devstack quobyte-client[82845]: System call of process 90895 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:47:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-f3a4e4d7-b89c-41d1-9559-952969c53a4d req-33fa2e78-880f-4cbe-ab99-18280bbb945a tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5321df85-0794-402b-81b1-4b4f20fc310c" returned: 0 in 1.607s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:47:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-f3a4e4d7-b89c-41d1-9559-952969c53a4d req-33fa2e78-880f-4cbe-ab99-18280bbb945a tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.845s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:48:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-f3a4e4d7-b89c-41d1-9559-952969c53a4d req-33fa2e78-880f-4cbe-ab99-18280bbb945a tempest-TestInstancesWithCinderVolumes-602423865 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-5321df85-0794-402b-81b1-4b4f20fc310c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80aa4485-404e-478b-b6ad-086b87ca9f16', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:48:00 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-f3a4e4d7-b89c-41d1-9559-952969c53a4d req-33fa2e78-880f-4cbe-ab99-18280bbb945a tempest-TestInstancesWithCinderVolumes-602423865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:48:00 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-f3a4e4d7-b89c-41d1-9559-952969c53a4d req-33fa2e78-880f-4cbe-ab99-18280bbb945a tempest-TestInstancesWithCinderVolumes-602423865 None] attachment_update completed successfully.
Sep 10 13:48:10 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:48:10 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:48:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-ecc9bc6e-1f3a-495d-9450-3ab5e9eb5910 req-c2cbcf6a-dbae-4144-8905-1bb664a0c8ae tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:48:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-ecc9bc6e-1f3a-495d-9450-3ab5e9eb5910 req-c2cbcf6a-dbae-4144-8905-1bb664a0c8ae tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:48:14 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[092dbb28-a3e9-4bed-84a2-5fbf5bcf6b24]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:48:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-ecc9bc6e-1f3a-495d-9450-3ab5e9eb5910 req-c2cbcf6a-dbae-4144-8905-1bb664a0c8ae tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-12cb7059-e21f-4456-bca8-5a1e52857411 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:48:14 devstack quobyte-client[82845]: System call of process 90922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:48:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-ecc9bc6e-1f3a-495d-9450-3ab5e9eb5910 req-c2cbcf6a-dbae-4144-8905-1bb664a0c8ae tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-12cb7059-e21f-4456-bca8-5a1e52857411" returned: 0 in 0.793s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:48:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-ecc9bc6e-1f3a-495d-9450-3ab5e9eb5910 req-c2cbcf6a-dbae-4144-8905-1bb664a0c8ae tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.862s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:48:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-ecc9bc6e-1f3a-495d-9450-3ab5e9eb5910 req-c2cbcf6a-dbae-4144-8905-1bb664a0c8ae tempest-TestInstancesWithCinderVolumes-602423865 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-12cb7059-e21f-4456-bca8-5a1e52857411', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02a1524a-e044-4b04-b5eb-203354228ce7', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:48:15 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-ecc9bc6e-1f3a-495d-9450-3ab5e9eb5910 req-c2cbcf6a-dbae-4144-8905-1bb664a0c8ae tempest-TestInstancesWithCinderVolumes-602423865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:48:15 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-ecc9bc6e-1f3a-495d-9450-3ab5e9eb5910 req-c2cbcf6a-dbae-4144-8905-1bb664a0c8ae tempest-TestInstancesWithCinderVolumes-602423865 None] attachment_update completed successfully.
Sep 10 13:48:25 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:48:25 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:48:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:48:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:48:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:48:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:48:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:48:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:48:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:48:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.265s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:48:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:48:55 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-9b6bc6bb-27e1-44cc-b285-a9a54a001755 req-423141e8-8256-47a7-8905-00cad276c6b1 tempest-TestInstancesWithCinderVolumes-602423865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:48:55 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-9b6bc6bb-27e1-44cc-b285-a9a54a001755 req-423141e8-8256-47a7-8905-00cad276c6b1 tempest-TestInstancesWithCinderVolumes-602423865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:48:55 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-9b6bc6bb-27e1-44cc-b285-a9a54a001755 req-423141e8-8256-47a7-8905-00cad276c6b1 tempest-TestInstancesWithCinderVolumes-602423865 None] Terminate volume connection completed successfully.
Sep 10 13:48:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-9b6bc6bb-27e1-44cc-b285-a9a54a001755 req-423141e8-8256-47a7-8905-00cad276c6b1 tempest-TestInstancesWithCinderVolumes-602423865 None] Deleting attachment 80aa4485-404e-478b-b6ad-086b87ca9f16. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:48:56 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "cinder-5321df85-0794-402b-81b1-4b4f20fc310c-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:48:56 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "cinder-5321df85-0794-402b-81b1-4b4f20fc310c-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:48:57 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:48:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "cinder-quobyte-5321df85-0794-402b-81b1-4b4f20fc310c" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:48:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "cinder-quobyte-5321df85-0794-402b-81b1-4b4f20fc310c" acquired by "delete_volume" :: waited 0.027s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:48:57 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf5c033-79a4-4450-8413-c019f0cf8efc]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:48:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5321df85-0794-402b-81b1-4b4f20fc310c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:48:57 devstack quobyte-client[82845]: System call of process 91212 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:48:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5321df85-0794-402b-81b1-4b4f20fc310c" returned: 0 in 0.734s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:48:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5321df85-0794-402b-81b1-4b4f20fc310c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:48:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5321df85-0794-402b-81b1-4b4f20fc310c" returned: 0 in 0.268s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:48:58 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "cinder-quobyte-5321df85-0794-402b-81b1-4b4f20fc310c" released by "delete_volume" :: held 1.337s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:48:58 devstack cinder-volume[82823]: WARNING cinder.quota [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-172676201-1606343159 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-172676201-1606343159, it is now deprecated. Please use the default quota class for default quota.
Sep 10 13:48:58 devstack cinder-volume[82823]: WARNING cinder.quota [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-172676201-1606343159 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-172676201-1606343159, it is now deprecated. Please use the default quota class for default quota.
Sep 10 13:48:58 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Created reservations ['83dfe8d0-4f28-4517-9ed5-a5b16e209490', '3d347c44-939e-4be3-aab6-b954a79ac23d', 'd12da107-3046-460c-8ebd-5b6bb3df03ac', '35f90fb6-b4df-4b04-a167-70d1b474e9b4'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:48:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:48:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:48:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:48:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:48:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:48:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:48:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.126s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:48:59 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:48:59 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Deleted volume successfully.
Sep 10 13:48:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-27bb472b-968d-422c-82ac-ee09d2fea23f tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "cinder-5321df85-0794-402b-81b1-4b4f20fc310c-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:49:04 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Flow 'volume_create_manager' (1e6e022a-798e-4926-972c-e7d3aa8dd540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e087412-2b42-40c8-b283-e6dba0eeb82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e087412-2b42-40c8-b283-e6dba0eeb82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-688480939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d100c248-85b8-4010-83b3-4c1e70b2b6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2083dc5bd0e4deca2883bd912bef517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:49:05Z,use_quota=True,user_id='a8681af4d17747ff8cec1207e5199355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fad371-e81d-49c6-84e1-67cdf4b10154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fad371-e81d-49c6-84e1-67cdf4b10154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b432b0f-9b94-4dc3-a8fa-ee5e57564853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b432b0f-9b94-4dc3-a8fa-ee5e57564853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd100c248-85b8-4010-83b3-4c1e70b2b6c4', 'volume_name': 'volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712750b0-9cd5-4d20-8fd3-7edadc405331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712750b0-9cd5-4d20-8fd3-7edadc405331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfa550c-1ac1-4361-909b-42f2e52a613a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:49:05 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Volume d100c248-85b8-4010-83b3-4c1e70b2b6c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4', 'volume_size': 1}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-688480939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d100c248-85b8-4010-83b3-4c1e70b2b6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2083dc5bd0e4deca2883bd912bef517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:49:05Z,use_quota=True,user_id='a8681af4d17747ff8cec1207e5199355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Creating volume d100c248-85b8-4010-83b3-4c1e70b2b6c4 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:49:05 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:49:05 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=45, name=volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4 1073741824" returned: 0 in 0.495s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4" returned: 0 in 0.167s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] <== create_volume: return (799ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:49:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:49:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfa550c-1ac1-4361-909b-42f2e52a613a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:49:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddff32c5-786a-4068-9579-9935462dac04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:49:06 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Volume volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4 (d100c248-85b8-4010-83b3-4c1e70b2b6c4): created successfully
Sep 10 13:49:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddff32c5-786a-4068-9579-9935462dac04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:49:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Flow 'volume_create_manager' (1e6e022a-798e-4926-972c-e7d3aa8dd540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:49:06 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-d21a706b-b874-4033-9004-0b552cfd076a tempest-AttachVolumeShelveTestJSON-1600694697 None] Created volume successfully.
Sep 10 13:49:16 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:49:16 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:49:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:49:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:49:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:49:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:49:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:49:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:49:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:49:29 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-42fd3fc6-e9e4-496e-a6a6-a762e5f2cc23 req-c7f72066-b1ee-4dc2-844d-eb52dcc53440 tempest-TestInstancesWithCinderVolumes-602423865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:49:29 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-42fd3fc6-e9e4-496e-a6a6-a762e5f2cc23 req-c7f72066-b1ee-4dc2-844d-eb52dcc53440 tempest-TestInstancesWithCinderVolumes-602423865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:49:29 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-42fd3fc6-e9e4-496e-a6a6-a762e5f2cc23 req-c7f72066-b1ee-4dc2-844d-eb52dcc53440 tempest-TestInstancesWithCinderVolumes-602423865 None] Terminate volume connection completed successfully.
Sep 10 13:49:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-42fd3fc6-e9e4-496e-a6a6-a762e5f2cc23 req-c7f72066-b1ee-4dc2-844d-eb52dcc53440 tempest-TestInstancesWithCinderVolumes-602423865 None] Deleting attachment 02a1524a-e044-4b04-b5eb-203354228ce7. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:49:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.436s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:49:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:49:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "cinder-12cb7059-e21f-4456-bca8-5a1e52857411-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:49:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "cinder-12cb7059-e21f-4456-bca8-5a1e52857411-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:49:31 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:49:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "cinder-quobyte-12cb7059-e21f-4456-bca8-5a1e52857411" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:49:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "cinder-quobyte-12cb7059-e21f-4456-bca8-5a1e52857411" acquired by "delete_volume" :: waited 0.018s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:49:31 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0a3f16-0afc-4dc9-bfc8-a8baa9f1d0f9]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:49:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-12cb7059-e21f-4456-bca8-5a1e52857411 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:49:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-12cb7059-e21f-4456-bca8-5a1e52857411" returned: 0 in 0.656s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:49:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-12cb7059-e21f-4456-bca8-5a1e52857411 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:49:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-12cb7059-e21f-4456-bca8-5a1e52857411" returned: 0 in 0.167s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:49:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "cinder-quobyte-12cb7059-e21f-4456-bca8-5a1e52857411" released by "delete_volume" :: held 1.113s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:49:32 devstack cinder-volume[82823]: WARNING cinder.quota [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1307794795-1911837730 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1307794795-1911837730, it is now deprecated. Please use the default quota class for default quota.
Sep 10 13:49:32 devstack cinder-volume[82823]: WARNING cinder.quota [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1307794795-1911837730 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1307794795-1911837730, it is now deprecated. Please use the default quota class for default quota.
Sep 10 13:49:32 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Created reservations ['bd9d0ade-8b16-4145-93dc-27bf7cb1a739', 'd5c16df9-0fe1-47fa-a4b9-7b6842ab7ea5', 'f1274aea-2f88-4996-bf06-30fa7e39ef03', '1791f7cd-944e-4529-8fe3-e42ffa53698b'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:49:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:49:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:49:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:49:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:49:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:49:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:49:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.226s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:49:33 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:49:33 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Deleted volume successfully.
Sep 10 13:49:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bdfb8287-01e4-44dc-b95c-73e3cbfd0450 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "cinder-12cb7059-e21f-4456-bca8-5a1e52857411-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:49:42 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:49:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-462a5dea-6aca-4142-9a96-4c841aaee0a3 req-6b2fb47a-99b6-471b-b1d7-a7ff6e5847e3 tempest-AttachVolumeShelveTestJSON-1600694697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:49:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-462a5dea-6aca-4142-9a96-4c841aaee0a3 req-6b2fb47a-99b6-471b-b1d7-a7ff6e5847e3 tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:49:43 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad26ef25-8cbe-4afe-b5ba-00f714a86267]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:49:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-462a5dea-6aca-4142-9a96-4c841aaee0a3 req-6b2fb47a-99b6-471b-b1d7-a7ff6e5847e3 tempest-AttachVolumeShelveTestJSON-1600694697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:49:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-462a5dea-6aca-4142-9a96-4c841aaee0a3 req-6b2fb47a-99b6-471b-b1d7-a7ff6e5847e3 tempest-AttachVolumeShelveTestJSON-1600694697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4" returned: 0 in 0.992s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:49:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-462a5dea-6aca-4142-9a96-4c841aaee0a3 req-6b2fb47a-99b6-471b-b1d7-a7ff6e5847e3 tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.126s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:49:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-462a5dea-6aca-4142-9a96-4c841aaee0a3 req-6b2fb47a-99b6-471b-b1d7-a7ff6e5847e3 tempest-AttachVolumeShelveTestJSON-1600694697 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb699c56-fa4a-4aa0-b058-ded4a4dd751f', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:49:44 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-462a5dea-6aca-4142-9a96-4c841aaee0a3 req-6b2fb47a-99b6-471b-b1d7-a7ff6e5847e3 tempest-AttachVolumeShelveTestJSON-1600694697 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:49:44 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-462a5dea-6aca-4142-9a96-4c841aaee0a3 req-6b2fb47a-99b6-471b-b1d7-a7ff6e5847e3 tempest-AttachVolumeShelveTestJSON-1600694697 None] attachment_update completed successfully.
Sep 10 13:49:45 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-e74329f2-cf27-47ab-b1cc-7717818d02e9 req-e10ea0a5-370b-492f-b74a-b1da84dc0b67 tempest-TestInstancesWithCinderVolumes-602423865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:49:45 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-e74329f2-cf27-47ab-b1cc-7717818d02e9 req-e10ea0a5-370b-492f-b74a-b1da84dc0b67 tempest-TestInstancesWithCinderVolumes-602423865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:49:45 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-e74329f2-cf27-47ab-b1cc-7717818d02e9 req-e10ea0a5-370b-492f-b74a-b1da84dc0b67 tempest-TestInstancesWithCinderVolumes-602423865 None] Terminate volume connection completed successfully.
Sep 10 13:49:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-e74329f2-cf27-47ab-b1cc-7717818d02e9 req-e10ea0a5-370b-492f-b74a-b1da84dc0b67 tempest-TestInstancesWithCinderVolumes-602423865 None] Deleting attachment 630f513c-23bc-4935-ba40-2e694db64c6c. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:49:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "cinder-bbed8312-e656-420f-bbf9-d5ac05f80ad2-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:49:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "cinder-bbed8312-e656-420f-bbf9-d5ac05f80ad2-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:49:52 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:49:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "cinder-quobyte-bbed8312-e656-420f-bbf9-d5ac05f80ad2" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:49:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "cinder-quobyte-bbed8312-e656-420f-bbf9-d5ac05f80ad2" acquired by "delete_volume" :: waited 0.017s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:49:52 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[8194a4e1-aa83-4bd0-89e6-9d4f5a405a61]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:49:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:49:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2" returned: 0 in 0.571s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:49:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:49:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2" returned: 1 in 0.916s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:49:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 13:49:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:49:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bbed8312-e656-420f-bbf9-d5ac05f80ad2" returned: 0 in 0.964s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:49:55 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:49:55 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:49:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Flow 'volume_create_manager' (01f18a07-ad18-4f73-8c87-519b72732d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:49:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f596dc41-fa74-47a7-9a03-27637c811975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:49:55 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "cinder-quobyte-bbed8312-e656-420f-bbf9-d5ac05f80ad2" released by "delete_volume" :: held 3.378s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f596dc41-fa74-47a7-9a03-27637c811975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1010983124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223ebeef-46ac-4fe2-9c17-5aa76c14be3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e704ca7af643cb9f411a5ebdc300c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:49:55Z,use_quota=True,user_id='c249bc1a11df4e688ba4d76fe08b479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57132f7-3668-42cb-ac4d-ba37e65913dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57132f7-3668-42cb-ac4d-ba37e65913dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701413c8-74c2-4084-840e-29c592da6836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701413c8-74c2-4084-840e-29c592da6836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '223ebeef-46ac-4fe2-9c17-5aa76c14be3a', 'volume_name': 'volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312f4b65-a194-428b-8f5d-f7b975851aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312f4b65-a194-428b-8f5d-f7b975851aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067e5b02-39e5-43b1-acc1-793080564766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:49:56 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Volume 223ebeef-46ac-4fe2-9c17-5aa76c14be3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a', 'volume_size': 1}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1010983124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223ebeef-46ac-4fe2-9c17-5aa76c14be3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e704ca7af643cb9f411a5ebdc300c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:49:55Z,use_quota=True,user_id='c249bc1a11df4e688ba4d76fe08b479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Creating volume 223ebeef-46ac-4fe2-9c17-5aa76c14be3a {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:49:56 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:49:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:49:56 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=46, name=volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:49:56 devstack cinder-volume[82823]: WARNING cinder.quota [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744082470-1264200064 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744082470-1264200064, it is now deprecated. Please use the default quota class for default quota.
Sep 10 13:49:56 devstack cinder-volume[82823]: WARNING cinder.quota [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744082470-1264200064 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744082470-1264200064, it is now deprecated. Please use the default quota class for default quota.
Sep 10 13:49:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a 1073741824" returned: 0 in 0.682s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:49:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:49:57 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Created reservations ['b378ff49-3a12-461b-9f3f-de9b1e7d0c15', 'bd38ab64-a36a-434c-b9b2-d05a9e45fd37', '0833cb62-4423-4084-9107-8fabec4ae0c8', '6e651549-a149-4efd-8c97-214702352bbb'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:49:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a" returned: 0 in 0.579s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:49:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] <== create_volume: return (1289ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:49:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:49:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067e5b02-39e5-43b1-acc1-793080564766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:49:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58202d0-28e7-4e6b-b673-b10f679047d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:49:57 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Volume volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a (223ebeef-46ac-4fe2-9c17-5aa76c14be3a): created successfully
Sep 10 13:49:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58202d0-28e7-4e6b-b673-b10f679047d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:49:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Flow 'volume_create_manager' (01f18a07-ad18-4f73-8c87-519b72732d81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:49:57 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-78237a16-cdbe-4846-af81-6ebaf7f4a3d9 tempest-AttachVolumeNegativeTest-183563189 None] Created volume successfully.
Sep 10 13:49:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:49:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:49:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:49:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:49:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:49:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:49:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.169s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:49:58 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:49:58 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Deleted volume successfully.
Sep 10 13:49:58 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a3abfca4-337b-460b-9382-edff41413269 tempest-TestInstancesWithCinderVolumes-602423865 None] Lock "cinder-bbed8312-e656-420f-bbf9-d5ac05f80ad2-delete_volume" released by "delete_volume" :: held 6.393s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:50:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-44696c60-977d-471e-83d9-609497ffc4cd req-794e4627-0580-4aa7-b656-a07e933d0c70 tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:50:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-44696c60-977d-471e-83d9-609497ffc4cd req-794e4627-0580-4aa7-b656-a07e933d0c70 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:50:03 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d1ec3f-665d-4e99-a322-20339b41e268]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:50:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-44696c60-977d-471e-83d9-609497ffc4cd req-794e4627-0580-4aa7-b656-a07e933d0c70 tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:50:04 devstack quobyte-client[82845]: System call of process 91528 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:50:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-44696c60-977d-471e-83d9-609497ffc4cd req-794e4627-0580-4aa7-b656-a07e933d0c70 tempest-AttachVolumeNegativeTest-183563189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a" returned: 0 in 0.545s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:50:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-44696c60-977d-471e-83d9-609497ffc4cd req-794e4627-0580-4aa7-b656-a07e933d0c70 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.603s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:50:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-44696c60-977d-471e-83d9-609497ffc4cd req-794e4627-0580-4aa7-b656-a07e933d0c70 tempest-AttachVolumeNegativeTest-183563189 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ab2b4e9-bdfb-4d06-8d62-1305c7534db3', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:50:05 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-44696c60-977d-471e-83d9-609497ffc4cd req-794e4627-0580-4aa7-b656-a07e933d0c70 tempest-AttachVolumeNegativeTest-183563189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:50:05 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-44696c60-977d-471e-83d9-609497ffc4cd req-794e4627-0580-4aa7-b656-a07e933d0c70 tempest-AttachVolumeNegativeTest-183563189 None] attachment_update completed successfully.
Sep 10 13:50:15 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=18,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:50:15 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=25,cinder:INSERT=3,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:50:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:50:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:50:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:50:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:50:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:50:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:50:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:50:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.326s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:50:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:51:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:51:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:51:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:51:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:51:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:51:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:51:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:51:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.260s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:51:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:51:50 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Flow 'volume_create_manager' (51aa7a0e-ef01-4089-8ac4-85b10e6936d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d516b89b-3d98-4549-8c5b-6c5364209c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d516b89b-3d98-4549-8c5b-6c5364209c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1441071925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f719b32-9274-45fd-b2d8-f5aba815a8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d68acfca0034519a0bd5fc86ee53dc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:51:50Z,use_quota=True,user_id='fdb2cb505ca849488601280873fc65ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a08fb2-92c3-4559-851e-4f000e2cc0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a08fb2-92c3-4559-851e-4f000e2cc0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50cbb94a-1ece-4919-8a8e-fbc3be6d2266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50cbb94a-1ece-4919-8a8e-fbc3be6d2266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f719b32-9274-45fd-b2d8-f5aba815a8b7', 'volume_name': 'volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa0f46a-0ba6-4c99-9d11-9d14d4b81337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa0f46a-0ba6-4c99-9d11-9d14d4b81337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d467f77-b210-4648-aca5-937bf4ec56f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:51:50 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Volume 3f719b32-9274-45fd-b2d8-f5aba815a8b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7', 'volume_size': 1}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1441071925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f719b32-9274-45fd-b2d8-f5aba815a8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d68acfca0034519a0bd5fc86ee53dc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:51:50Z,use_quota=True,user_id='fdb2cb505ca849488601280873fc65ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Creating volume 3f719b32-9274-45fd-b2d8-f5aba815a8b7 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:51:50 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:51:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:51:50 devstack quobyte-client[82845]: System call of process 92395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:51:51 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=47, name=volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:51:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7 1073741824" returned: 0 in 0.521s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:51:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:51:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7" returned: 0 in 0.189s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:51:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] <== create_volume: return (807ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:51:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:51:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d467f77-b210-4648-aca5-937bf4ec56f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:51:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68aaa945-cd29-4038-bc66-2c53acbad950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:51:51 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Volume volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7 (3f719b32-9274-45fd-b2d8-f5aba815a8b7): created successfully
Sep 10 13:51:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68aaa945-cd29-4038-bc66-2c53acbad950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:51:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Flow 'volume_create_manager' (51aa7a0e-ef01-4089-8ac4-85b10e6936d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:51:51 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-64a12178-1668-4133-9bd4-8d7e0981b45b tempest-TestMinimumBasicScenario-2024375419 None] Created volume successfully.
Sep 10 13:51:55 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-8bf55ac3-d7ef-4534-8f4c-bd693fca471e req-bc6dddbc-6086-4f76-9fd1-25571f667147 tempest-AttachVolumeShelveTestJSON-1600694697 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:51:55 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-8bf55ac3-d7ef-4534-8f4c-bd693fca471e req-bc6dddbc-6086-4f76-9fd1-25571f667147 tempest-AttachVolumeShelveTestJSON-1600694697 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:51:55 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-8bf55ac3-d7ef-4534-8f4c-bd693fca471e req-bc6dddbc-6086-4f76-9fd1-25571f667147 tempest-AttachVolumeShelveTestJSON-1600694697 None] Terminate volume connection completed successfully.
Sep 10 13:51:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8bf55ac3-d7ef-4534-8f4c-bd693fca471e req-bc6dddbc-6086-4f76-9fd1-25571f667147 tempest-AttachVolumeShelveTestJSON-1600694697 None] Deleting attachment fb699c56-fa4a-4aa0-b058-ded4a4dd751f. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:51:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-09c0194b-4f01-4b50-a27a-80ac125209b1 req-7ff34fd4-119c-416f-82f5-65c0ef4e4d0a tempest-TestMinimumBasicScenario-2024375419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:51:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-09c0194b-4f01-4b50-a27a-80ac125209b1 req-7ff34fd4-119c-416f-82f5-65c0ef4e4d0a tempest-TestMinimumBasicScenario-2024375419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:51:58 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdcb012-f829-4b16-8a26-4096666beceb]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:51:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-09c0194b-4f01-4b50-a27a-80ac125209b1 req-7ff34fd4-119c-416f-82f5-65c0ef4e4d0a tempest-TestMinimumBasicScenario-2024375419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:52:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-09c0194b-4f01-4b50-a27a-80ac125209b1 req-7ff34fd4-119c-416f-82f5-65c0ef4e4d0a tempest-TestMinimumBasicScenario-2024375419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7" returned: 0 in 2.005s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:52:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-09c0194b-4f01-4b50-a27a-80ac125209b1 req-7ff34fd4-119c-416f-82f5-65c0ef4e4d0a tempest-TestMinimumBasicScenario-2024375419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.236s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:52:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-09c0194b-4f01-4b50-a27a-80ac125209b1 req-7ff34fd4-119c-416f-82f5-65c0ef4e4d0a tempest-TestMinimumBasicScenario-2024375419 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8184641-5550-4565-a281-a9089ccf0f60', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:52:02 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-09c0194b-4f01-4b50-a27a-80ac125209b1 req-7ff34fd4-119c-416f-82f5-65c0ef4e4d0a tempest-TestMinimumBasicScenario-2024375419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:52:02 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-09c0194b-4f01-4b50-a27a-80ac125209b1 req-7ff34fd4-119c-416f-82f5-65c0ef4e4d0a tempest-TestMinimumBasicScenario-2024375419 None] attachment_update completed successfully.
Sep 10 13:52:12 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=5,cinder:SELECT=8 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:52:12 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:52:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:52:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:52:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:52:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:52:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:52:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:52:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:52:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.257s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:52:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:52:48 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-54929b82-6a23-44dd-8573-4a22b8219f1e req-a2993796-cd54-4180-8172-25bd72309b95 tempest-AttachVolumeNegativeTest-183563189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:52:49 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-54929b82-6a23-44dd-8573-4a22b8219f1e req-a2993796-cd54-4180-8172-25bd72309b95 tempest-AttachVolumeNegativeTest-183563189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:52:49 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-54929b82-6a23-44dd-8573-4a22b8219f1e req-a2993796-cd54-4180-8172-25bd72309b95 tempest-AttachVolumeNegativeTest-183563189 None] Terminate volume connection completed successfully.
Sep 10 13:52:49 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-54929b82-6a23-44dd-8573-4a22b8219f1e req-a2993796-cd54-4180-8172-25bd72309b95 tempest-AttachVolumeNegativeTest-183563189 None] Deleting attachment 8ab2b4e9-bdfb-4d06-8d62-1305c7534db3. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:52:59 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:53:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:53:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:53:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:53:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:53:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:53:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:53:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:53:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.135s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:53:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:54:07 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:54:14 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Flow 'volume_create_manager' (cd85942a-3ce4-4118-8cf5-6ad77db58096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a53c8a-6e1a-471b-ad02-735faa4f432d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a53c8a-6e1a-471b-ad02-735faa4f432d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-541878190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5803668d-7689-4d1e-90f2-f6cb12b4f545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2083dc5bd0e4deca2883bd912bef517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:54:14Z,use_quota=True,user_id='a8681af4d17747ff8cec1207e5199355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9b2ebc-7a1f-41d1-99d3-7ef0a097a5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9b2ebc-7a1f-41d1-99d3-7ef0a097a5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d44fa79-a074-49e8-ba72-81d2ac139791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d44fa79-a074-49e8-ba72-81d2ac139791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5803668d-7689-4d1e-90f2-f6cb12b4f545', 'volume_name': 'volume-5803668d-7689-4d1e-90f2-f6cb12b4f545', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f8be5f-a776-4309-beb2-16e0e4726d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f8be5f-a776-4309-beb2-16e0e4726d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb677d4-b2c8-41b3-93d2-91b80bbcbd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:54:14 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Volume 5803668d-7689-4d1e-90f2-f6cb12b4f545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5803668d-7689-4d1e-90f2-f6cb12b4f545', 'volume_size': 1}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-541878190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5803668d-7689-4d1e-90f2-f6cb12b4f545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2083dc5bd0e4deca2883bd912bef517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:54:14Z,use_quota=True,user_id='a8681af4d17747ff8cec1207e5199355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Creating volume 5803668d-7689-4d1e-90f2-f6cb12b4f545 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:54:14 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:54:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5803668d-7689-4d1e-90f2-f6cb12b4f545 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:54:14 devstack quobyte-client[82845]: System call of process 93151 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:54:14 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=48, name=volume-5803668d-7689-4d1e-90f2-f6cb12b4f545, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:54:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5803668d-7689-4d1e-90f2-f6cb12b4f545 1073741824" returned: 0 in 0.613s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:54:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5803668d-7689-4d1e-90f2-f6cb12b4f545 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:54:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5803668d-7689-4d1e-90f2-f6cb12b4f545" returned: 0 in 0.117s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:54:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] <== create_volume: return (842ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:54:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:54:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb677d4-b2c8-41b3-93d2-91b80bbcbd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5803668d-7689-4d1e-90f2-f6cb12b4f545', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:54:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9dbfc7-5846-4496-a757-74eb61feaefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:54:15 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Volume volume-5803668d-7689-4d1e-90f2-f6cb12b4f545 (5803668d-7689-4d1e-90f2-f6cb12b4f545): created successfully
Sep 10 13:54:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9dbfc7-5846-4496-a757-74eb61feaefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:54:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Flow 'volume_create_manager' (cd85942a-3ce4-4118-8cf5-6ad77db58096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:54:16 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-4cd70ce7-3da7-4682-b304-37c4c7a78c66 tempest-AttachVolumeShelveTestJSON-1600694697 None] Created volume successfully.
Sep 10 13:54:26 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=3 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:54:26 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:54:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:54:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:54:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:54:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:54:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:54:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:54:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:54:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.349s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:54:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:54:51 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-bb6871e4-fd4c-4c2b-9ea3-480c1c174ebd req-3ed20440-f76b-46a3-ac1e-de7f47472a16 tempest-AttachVolumeShelveTestJSON-1600694697 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:54:51 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-bb6871e4-fd4c-4c2b-9ea3-480c1c174ebd req-3ed20440-f76b-46a3-ac1e-de7f47472a16 tempest-AttachVolumeShelveTestJSON-1600694697 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:54:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-bb6871e4-fd4c-4c2b-9ea3-480c1c174ebd req-3ed20440-f76b-46a3-ac1e-de7f47472a16 tempest-AttachVolumeShelveTestJSON-1600694697 None] No connector for attachment 52dd6aaa-42a8-4dbe-8377-a0b0eda6efc3; skipping storage backend terminate_connection call. {{(pid=82823) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 10 13:54:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-bb6871e4-fd4c-4c2b-9ea3-480c1c174ebd req-3ed20440-f76b-46a3-ac1e-de7f47472a16 tempest-AttachVolumeShelveTestJSON-1600694697 None] Deleting attachment 52dd6aaa-42a8-4dbe-8377-a0b0eda6efc3. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:55:01 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:55:07 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-03b02fb2-1973-4688-9ed8-05060f780635 req-aec3c0f8-5332-49c1-92c8-41bdca2a8be6 tempest-TestMinimumBasicScenario-2024375419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:55:07 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-03b02fb2-1973-4688-9ed8-05060f780635 req-aec3c0f8-5332-49c1-92c8-41bdca2a8be6 tempest-TestMinimumBasicScenario-2024375419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:55:07 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-03b02fb2-1973-4688-9ed8-05060f780635 req-aec3c0f8-5332-49c1-92c8-41bdca2a8be6 tempest-TestMinimumBasicScenario-2024375419 None] Terminate volume connection completed successfully.
Sep 10 13:55:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-03b02fb2-1973-4688-9ed8-05060f780635 req-aec3c0f8-5332-49c1-92c8-41bdca2a8be6 tempest-TestMinimumBasicScenario-2024375419 None] Deleting attachment e8184641-5550-4565-a281-a9089ccf0f60. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:55:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Acquiring lock "cinder-3f719b32-9274-45fd-b2d8-f5aba815a8b7-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:55:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Lock "cinder-3f719b32-9274-45fd-b2d8-f5aba815a8b7-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:55:10 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:55:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Acquiring lock "cinder-quobyte-3f719b32-9274-45fd-b2d8-f5aba815a8b7" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:55:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Lock "cinder-quobyte-3f719b32-9274-45fd-b2d8-f5aba815a8b7" acquired by "delete_volume" :: waited 0.029s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:55:11 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[d752b65e-abeb-4713-a3fa-fc84d072b8b5]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:55:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:55:11 devstack quobyte-client[82845]: System call of process 93528 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:55:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7" returned: 0 in 0.650s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:55:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:55:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3f719b32-9274-45fd-b2d8-f5aba815a8b7" returned: 0 in 0.113s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:55:11 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Lock "cinder-quobyte-3f719b32-9274-45fd-b2d8-f5aba815a8b7" released by "delete_volume" :: held 1.011s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:55:12 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Created reservations ['a860c3d1-346a-4e37-8e28-9975e4201c06', 'a4d7176d-87d3-46cb-8391-c7a1d416d9ab', '1d62c2b8-89d7-4cce-b2ad-56869a9a3c0b', '30a305bb-c2da-4100-a56c-d67004615483'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:55:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:55:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:55:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:55:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:55:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:55:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:55:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.204s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:55:12 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:55:13 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Deleted volume successfully.
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-044d398d-887d-4180-af09-c39bd1fd5806 tempest-TestMinimumBasicScenario-2024375419 None] Lock "cinder-3f719b32-9274-45fd-b2d8-f5aba815a8b7-delete_volume" released by "delete_volume" :: held 3.368s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:55:14 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Flow 'volume_create_manager' (ec9b8135-8435-45c8-91bf-74b9288de590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0d59fe-de12-46d0-bcf9-b86aaf4f1c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0d59fe-de12-46d0-bcf9-b86aaf4f1c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-691591346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993b7c52-5eae-442b-aa15-2fe20eff5461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e704ca7af643cb9f411a5ebdc300c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:55:13Z,use_quota=True,user_id='c249bc1a11df4e688ba4d76fe08b479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa9d16c-05d7-458b-842c-efadeff5172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa9d16c-05d7-458b-842c-efadeff5172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28a0c6a-a6f1-4f14-b5b6-18b01056f801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28a0c6a-a6f1-4f14-b5b6-18b01056f801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '993b7c52-5eae-442b-aa15-2fe20eff5461', 'volume_name': 'volume-993b7c52-5eae-442b-aa15-2fe20eff5461', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c557bcf-586e-47b5-b8db-227859bbf90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c557bcf-586e-47b5-b8db-227859bbf90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e94243-4640-4a48-b7d5-9825c038ff02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:55:14 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Volume 993b7c52-5eae-442b-aa15-2fe20eff5461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-993b7c52-5eae-442b-aa15-2fe20eff5461', 'volume_size': 1}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-691591346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993b7c52-5eae-442b-aa15-2fe20eff5461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e704ca7af643cb9f411a5ebdc300c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:55:13Z,use_quota=True,user_id='c249bc1a11df4e688ba4d76fe08b479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Creating volume 993b7c52-5eae-442b-aa15-2fe20eff5461 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:55:14 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:55:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-993b7c52-5eae-442b-aa15-2fe20eff5461 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:55:15 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=49, name=volume-993b7c52-5eae-442b-aa15-2fe20eff5461, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:55:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-993b7c52-5eae-442b-aa15-2fe20eff5461 1073741824" returned: 0 in 1.805s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:55:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-993b7c52-5eae-442b-aa15-2fe20eff5461 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:55:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-993b7c52-5eae-442b-aa15-2fe20eff5461" returned: 0 in 0.950s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:55:18 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] <== create_volume: return (3264ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:55:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.306s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:55:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e94243-4640-4a48-b7d5-9825c038ff02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993b7c52-5eae-442b-aa15-2fe20eff5461', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:55:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7857a465-d804-48de-a637-426fdd4fb1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:55:19 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Volume volume-993b7c52-5eae-442b-aa15-2fe20eff5461 (993b7c52-5eae-442b-aa15-2fe20eff5461): created successfully
Sep 10 13:55:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7857a465-d804-48de-a637-426fdd4fb1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:55:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Flow 'volume_create_manager' (ec9b8135-8435-45c8-91bf-74b9288de590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:55:19 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f665bd17-6e43-4aaa-a448-2861b3f79010 tempest-AttachVolumeNegativeTest-183563189 None] Created volume successfully.
Sep 10 13:55:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-aafe78ab-06d0-4729-b85b-af9dcb0b1736 req-007da2f6-f2e9-4c62-97ca-318c54ba5e78 tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:55:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-aafe78ab-06d0-4729-b85b-af9dcb0b1736 req-007da2f6-f2e9-4c62-97ca-318c54ba5e78 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:55:24 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[59083d49-ea45-47f7-aac7-893a87e7c5bc]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:55:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-aafe78ab-06d0-4729-b85b-af9dcb0b1736 req-007da2f6-f2e9-4c62-97ca-318c54ba5e78 tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-993b7c52-5eae-442b-aa15-2fe20eff5461 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:55:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-aafe78ab-06d0-4729-b85b-af9dcb0b1736 req-007da2f6-f2e9-4c62-97ca-318c54ba5e78 tempest-AttachVolumeNegativeTest-183563189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-993b7c52-5eae-442b-aa15-2fe20eff5461" returned: 0 in 0.623s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:55:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-aafe78ab-06d0-4729-b85b-af9dcb0b1736 req-007da2f6-f2e9-4c62-97ca-318c54ba5e78 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.768s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:55:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-aafe78ab-06d0-4729-b85b-af9dcb0b1736 req-007da2f6-f2e9-4c62-97ca-318c54ba5e78 tempest-AttachVolumeNegativeTest-183563189 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-993b7c52-5eae-442b-aa15-2fe20eff5461', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86a93abd-0a66-4bcd-a3b4-99ad88a6c1ad', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:55:25 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-aafe78ab-06d0-4729-b85b-af9dcb0b1736 req-007da2f6-f2e9-4c62-97ca-318c54ba5e78 tempest-AttachVolumeNegativeTest-183563189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:55:25 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-aafe78ab-06d0-4729-b85b-af9dcb0b1736 req-007da2f6-f2e9-4c62-97ca-318c54ba5e78 tempest-AttachVolumeNegativeTest-183563189 None] attachment_update completed successfully.
Sep 10 13:55:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:55:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:55:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:55:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:55:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:55:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:55:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:55:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.340s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:55:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:55:35 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=16,cinder:UPDATE=11 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:55:36 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=9,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:55:59 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-b2e44e79-5139-4634-ade3-4adceedaa53d req-0b41b0f5-4120-4c51-81c5-98fe6d776966 tempest-AttachVolumeNegativeTest-183563189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:55:59 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-b2e44e79-5139-4634-ade3-4adceedaa53d req-0b41b0f5-4120-4c51-81c5-98fe6d776966 tempest-AttachVolumeNegativeTest-183563189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:55:59 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-b2e44e79-5139-4634-ade3-4adceedaa53d req-0b41b0f5-4120-4c51-81c5-98fe6d776966 tempest-AttachVolumeNegativeTest-183563189 None] Terminate volume connection completed successfully.
Sep 10 13:55:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-b2e44e79-5139-4634-ade3-4adceedaa53d req-0b41b0f5-4120-4c51-81c5-98fe6d776966 tempest-AttachVolumeNegativeTest-183563189 None] Deleting attachment 86a93abd-0a66-4bcd-a3b4-99ad88a6c1ad. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:56:06 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:56:09 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:56:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:56:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:56:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:56:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:56:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:56:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:56:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:56:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.234s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:56:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:57:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Acquiring lock "cinder-5803668d-7689-4d1e-90f2-f6cb12b4f545-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:57:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "cinder-5803668d-7689-4d1e-90f2-f6cb12b4f545-delete_volume" acquired by "delete_volume" :: waited 0.212s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:57:15 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:57:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Acquiring lock "cinder-quobyte-5803668d-7689-4d1e-90f2-f6cb12b4f545" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:57:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "cinder-quobyte-5803668d-7689-4d1e-90f2-f6cb12b4f545" acquired by "delete_volume" :: waited 0.066s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:57:15 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a19efd-a3ef-41c7-a0cf-696e08907a4b]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:57:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5803668d-7689-4d1e-90f2-f6cb12b4f545 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5803668d-7689-4d1e-90f2-f6cb12b4f545" returned: 0 in 1.298s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5803668d-7689-4d1e-90f2-f6cb12b4f545 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5803668d-7689-4d1e-90f2-f6cb12b4f545" returned: 0 in 0.185s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "cinder-quobyte-5803668d-7689-4d1e-90f2-f6cb12b4f545" released by "delete_volume" :: held 1.960s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:57:18 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Created reservations ['e5965641-9a3b-4c84-ba56-c1493fa32ea8', '51e7674d-6aac-4edc-8329-da52e5963108', '44ef1102-3d7b-42c2-b08d-f60cb6371fc9', '5497e052-be42-404f-81c4-0881b462e6d4'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:57:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:57:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:57:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:57:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:57:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:57:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.270s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:19 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:57:19 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Deleted volume successfully.
Sep 10 13:57:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-29c09722-18f9-4ccc-a857-7a1df9cb85ca tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "cinder-5803668d-7689-4d1e-90f2-f6cb12b4f545-delete_volume" released by "delete_volume" :: held 5.131s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:57:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Acquiring lock "cinder-d100c248-85b8-4010-83b3-4c1e70b2b6c4-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:57:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "cinder-d100c248-85b8-4010-83b3-4c1e70b2b6c4-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:57:20 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:57:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Acquiring lock "cinder-quobyte-d100c248-85b8-4010-83b3-4c1e70b2b6c4" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:57:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "cinder-quobyte-d100c248-85b8-4010-83b3-4c1e70b2b6c4" acquired by "delete_volume" :: waited 0.030s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:57:20 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[5377260d-679c-4055-8295-b3c96e6414cb]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:57:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4" returned: 0 in 0.903s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d100c248-85b8-4010-83b3-4c1e70b2b6c4" returned: 0 in 0.235s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "cinder-quobyte-d100c248-85b8-4010-83b3-4c1e70b2b6c4" released by "delete_volume" :: held 1.452s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:57:22 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Created reservations ['ca2f0a6d-5c56-44c2-afd0-9e74aea71936', '94f22a0e-5e50-4b69-9810-e6532b4f152a', '6e53b145-c781-44b4-8ff8-8155f113c339', '3d5581ab-6d4d-4409-89b9-71d4abd8b64c'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:57:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:57:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:57:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:57:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:57:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:57:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.124s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:23 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:57:23 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Deleted volume successfully.
Sep 10 13:57:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7074cb18-d578-4064-aac3-4f3f0c1ecb56 tempest-AttachVolumeShelveTestJSON-1600694697 None] Lock "cinder-d100c248-85b8-4010-83b3-4c1e70b2b6c4-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:57:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:57:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:57:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:57:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:57:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:57:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:57:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.296s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:57:32 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=8,cinder:INSERT=5,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:57:33 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=12,cinder:UPDATE=18,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:57:39 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Flow 'volume_create_manager' (9da17dc2-2b67-4320-9575-c5828e715196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e3f7f4-7666-4b0b-b925-ede8e4e6d50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e3f7f4-7666-4b0b-b925-ede8e4e6d50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-869810973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd63b50-3ffc-4729-9978-1143f2d3f113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd4991c2d7c4b22bf539e11e1ffffc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:57:39Z,use_quota=True,user_id='b8376d9f079d436f8f506d79fbbfc4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f71f82-08d1-4448-b43f-ca874b9a749e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f71f82-08d1-4448-b43f-ca874b9a749e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d218e4-14f1-4db3-b54d-043df32126e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d218e4-14f1-4db3-b54d-043df32126e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd63b50-3ffc-4729-9978-1143f2d3f113', 'volume_name': 'volume-7cd63b50-3ffc-4729-9978-1143f2d3f113', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7e8d18-8960-442f-af99-14179e154b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7e8d18-8960-442f-af99-14179e154b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2cb24c-1c9c-4747-953d-3b81dec6c76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:57:39 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Volume 7cd63b50-3ffc-4729-9978-1143f2d3f113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd63b50-3ffc-4729-9978-1143f2d3f113', 'volume_size': 1}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-869810973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd63b50-3ffc-4729-9978-1143f2d3f113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd4991c2d7c4b22bf539e11e1ffffc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:57:39Z,use_quota=True,user_id='b8376d9f079d436f8f506d79fbbfc4a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Creating volume 7cd63b50-3ffc-4729-9978-1143f2d3f113 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:57:39 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:57:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:39 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=50, name=volume-7cd63b50-3ffc-4729-9978-1143f2d3f113, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:57:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113 1073741824" returned: 0 in 0.794s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113" returned: 0 in 0.190s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] <== create_volume: return (1084ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:57:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:57:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2cb24c-1c9c-4747-953d-3b81dec6c76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd63b50-3ffc-4729-9978-1143f2d3f113', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:57:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566b03e3-5e15-414e-94e1-72d04c3ec9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:57:40 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Volume volume-7cd63b50-3ffc-4729-9978-1143f2d3f113 (7cd63b50-3ffc-4729-9978-1143f2d3f113): created successfully
Sep 10 13:57:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566b03e3-5e15-414e-94e1-72d04c3ec9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:57:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Flow 'volume_create_manager' (9da17dc2-2b67-4320-9575-c5828e715196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:57:40 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-66ebdaf4-2559-4580-bdb0-d23bad6f18e0 req-0eef59d0-2f09-4ef0-af69-e27edf5b1858 tempest-VolumesSnapshotsTestJSON-1676173433 None] Created volume successfully.
Sep 10 13:57:42 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:57:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:57:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:57:42 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] Creating offline snapshot c6e09ab4-0f55-44f3-bd35-25957a38bc30 of volume 7cd63b50-3ffc-4729-9978-1143f2d3f113 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 13:57:42 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0d67b4-9f49-4ebd-b071-e2118132157f]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:57:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113" returned: 0 in 0.932s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:43 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=51, name=volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:57:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30 1G" returned: 0 in 0.726s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7cd63b50-3ffc-4729-9978-1143f2d3f113 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:44 devstack quobyte-client[82845]: System call of process 94700 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:57:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "qemu-img rebase -u -b volume-7cd63b50-3ffc-4729-9978-1143f2d3f113 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30" returned: 0 in 0.757s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:44 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:57:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30" returned: 0 in 0.170s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 13:57:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30" returned: 0 in 0.197s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.info" returned: 0 in 0.182s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:57:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.info" returned: 0 in 0.324s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.113s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:57:46 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-d170d19d-383d-4f2b-8fe1-d6545387ce03 req-ab1f2259-cafc-4d76-8a47-fd04a8cdb1b5 tempest-VolumesSnapshotsTestJSON-1676173433 None] Create snapshot completed successfully
Sep 10 13:57:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Acquiring lock "cinder-c6e09ab4-0f55-44f3-bd35-25957a38bc30-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:57:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "cinder-c6e09ab4-0f55-44f3-bd35-25957a38bc30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.149s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:57:47 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:57:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Acquiring lock "cinder-quobyte-7cd63b50-3ffc-4729-9978-1143f2d3f113" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:57:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "cinder-quobyte-7cd63b50-3ffc-4729-9978-1143f2d3f113" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:57:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Acquiring lock "cinder-quobyte-c6e09ab4-0f55-44f3-bd35-25957a38bc30" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:57:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "cinder-quobyte-c6e09ab4-0f55-44f3-bd35-25957a38bc30" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:57:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Deleting offline snapshot c6e09ab4-0f55-44f3-bd35-25957a38bc30 of volume 7cd63b50-3ffc-4729-9978-1143f2d3f113 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 13:57:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] snapshot_file for this snap is: volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 13:57:47 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[36779807-78c6-439a-a883-6a071138b342]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:57:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:48 devstack quobyte-client[82845]: System call of process 94710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:57:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30" returned: 0 in 0.794s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cd63b50-3ffc-4729-9978-1143f2d3f113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:57:48 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdba8e2-feb4-4e9b-833b-f43f73096b6d]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:57:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113" returned: 0 in 1.026s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:50 devstack quobyte-client[82845]: System call of process 94753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:57:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30" returned: 0 in 0.522s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113.c6e09ab4-0f55-44f3-bd35-25957a38bc30" returned: 0 in 0.142s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:50 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "cinder-quobyte-c6e09ab4-0f55-44f3-bd35-25957a38bc30" released by "_delete_snapshot" :: held 3.064s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:57:50 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "cinder-quobyte-7cd63b50-3ffc-4729-9978-1143f2d3f113" released by "delete_snapshot" :: held 3.095s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:57:51 devstack cinder-volume[82823]: DEBUG cinder.quota [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Created reservations ['47cebc58-038c-451f-91b5-fdf05cc4d807', '5ba5d16b-9eaa-4b9f-a8f1-504af699a297', 'e109f869-d36e-4a02-9bd3-aaa2d537bfcc', '6e916840-3503-424a-a254-23c593c1e4de'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:57:51 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Delete snapshot completed successfully.
Sep 10 13:57:51 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-e3544830-4c79-49e4-8576-baed8a204606 req-339aa153-ed47-4654-8348-74c451929025 tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "cinder-c6e09ab4-0f55-44f3-bd35-25957a38bc30-delete_snapshot" released by "delete_snapshot" :: held 3.715s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:57:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Acquiring lock "cinder-7cd63b50-3ffc-4729-9978-1143f2d3f113-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:57:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "cinder-7cd63b50-3ffc-4729-9978-1143f2d3f113-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:57:52 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:57:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Acquiring lock "cinder-quobyte-7cd63b50-3ffc-4729-9978-1143f2d3f113" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:57:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "cinder-quobyte-7cd63b50-3ffc-4729-9978-1143f2d3f113" acquired by "delete_volume" :: waited 0.018s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:57:52 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8866ad-271e-4104-925c-bed898c4e950]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:57:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113" returned: 0 in 0.535s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7cd63b50-3ffc-4729-9978-1143f2d3f113" returned: 0 in 0.113s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "cinder-quobyte-7cd63b50-3ffc-4729-9978-1143f2d3f113" released by "delete_volume" :: held 0.869s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:57:53 devstack cinder-volume[82823]: DEBUG cinder.quota [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Created reservations ['769b8459-bb23-4619-9737-f58bcf4a1e44', '0e6514a2-8004-42bc-a335-778dccf743b5', 'f44e5f1a-1aef-467c-9e65-7f891b7d97a6', '1d69fb89-09cc-48d3-833b-14261b164949'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:57:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:57:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:57:54 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:57:54 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:57:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:57:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:57:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.123s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:57:54 devstack cinder-volume[82823]: DEBUG cinder.manager [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:57:54 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Deleted volume successfully.
Sep 10 13:57:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-430c9aa6-7332-40f5-9614-49f1c591ceb6 req-5261c337-e88e-45a8-8115-a26546ef9fbc tempest-VolumesSnapshotsTestJSON-1676173433 None] Lock "cinder-7cd63b50-3ffc-4729-9978-1143f2d3f113-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:58:01 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Flow 'volume_create_manager' (5501483c-b5b8-4581-873b-fcaf73c6d93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9f1f1b-ad59-4f06-9e6e-64980de7146c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9f1f1b-ad59-4f06-9e6e-64980de7146c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-306653590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92e71b1-6806-41d5-95a4-dfb6db03b828,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bead765503484264a4bdb5c356eb6189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:01Z,use_quota=True,user_id='eeb5872a5ea44e1fb95670b62ec8b875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a7cdd6-0350-46ef-b0ac-bc5fb7af5c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a7cdd6-0350-46ef-b0ac-bc5fb7af5c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02273df-c1ca-462a-bb2e-6a9bacee201c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02273df-c1ca-462a-bb2e-6a9bacee201c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92e71b1-6806-41d5-95a4-dfb6db03b828', 'volume_name': 'volume-a92e71b1-6806-41d5-95a4-dfb6db03b828', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe61a332-f047-4cbd-a36f-6978bebe3679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe61a332-f047-4cbd-a36f-6978bebe3679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b992aa76-8291-45a4-851e-853c1693cfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:01 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Volume a92e71b1-6806-41d5-95a4-dfb6db03b828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92e71b1-6806-41d5-95a4-dfb6db03b828', 'volume_size': 1}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-306653590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92e71b1-6806-41d5-95a4-dfb6db03b828,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bead765503484264a4bdb5c356eb6189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:01Z,use_quota=True,user_id='eeb5872a5ea44e1fb95670b62ec8b875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Creating volume a92e71b1-6806-41d5-95a4-dfb6db03b828 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:58:01 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:58:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a92e71b1-6806-41d5-95a4-dfb6db03b828 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:02 devstack quobyte-client[82845]: System call of process 94773 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:58:02 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=53, name=volume-a92e71b1-6806-41d5-95a4-dfb6db03b828, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:58:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a92e71b1-6806-41d5-95a4-dfb6db03b828 1073741824" returned: 0 in 0.805s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a92e71b1-6806-41d5-95a4-dfb6db03b828 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a92e71b1-6806-41d5-95a4-dfb6db03b828" returned: 0 in 0.157s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] <== create_volume: return (1066ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:58:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b992aa76-8291-45a4-851e-853c1693cfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92e71b1-6806-41d5-95a4-dfb6db03b828', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011b41b2-719b-4168-be51-a984b074c110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:03 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Volume volume-a92e71b1-6806-41d5-95a4-dfb6db03b828 (a92e71b1-6806-41d5-95a4-dfb6db03b828): created successfully
Sep 10 13:58:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011b41b2-719b-4168-be51-a984b074c110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Flow 'volume_create_manager' (5501483c-b5b8-4581-873b-fcaf73c6d93c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:58:03 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-67dd66c4-e177-4b92-87a4-eafa5b34a9fd tempest-VolumesTestJSON-535572934 None] Created volume successfully.
Sep 10 13:58:05 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Flow 'volume_create_manager' (7d12a63b-7010-493c-9747-e8ebf5df5b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb5d6bd-8baf-406b-903d-89bcfff31b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb5d6bd-8baf-406b-903d-89bcfff31b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1910460010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2012fdc-89e4-4350-96a7-7d6358e8fb96,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bead765503484264a4bdb5c356eb6189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:05Z,use_quota=True,user_id='eeb5872a5ea44e1fb95670b62ec8b875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c672382-e5cc-49b4-981d-c1d8c70dbf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c672382-e5cc-49b4-981d-c1d8c70dbf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1d7686-66b4-4cfd-aab8-373e153714f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1d7686-66b4-4cfd-aab8-373e153714f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2012fdc-89e4-4350-96a7-7d6358e8fb96', 'volume_name': 'volume-a2012fdc-89e4-4350-96a7-7d6358e8fb96', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33de7268-7444-4618-9a97-d3b3fdd62974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33de7268-7444-4618-9a97-d3b3fdd62974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7268a897-b9e6-4667-bfa2-5c87ccb703b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:05 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Volume a2012fdc-89e4-4350-96a7-7d6358e8fb96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2012fdc-89e4-4350-96a7-7d6358e8fb96', 'volume_size': 1}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1910460010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2012fdc-89e4-4350-96a7-7d6358e8fb96,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bead765503484264a4bdb5c356eb6189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:05Z,use_quota=True,user_id='eeb5872a5ea44e1fb95670b62ec8b875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Creating volume a2012fdc-89e4-4350-96a7-7d6358e8fb96 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:58:05 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:58:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a2012fdc-89e4-4350-96a7-7d6358e8fb96 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:06 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=54, name=volume-a2012fdc-89e4-4350-96a7-7d6358e8fb96, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:58:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a2012fdc-89e4-4350-96a7-7d6358e8fb96 1073741824" returned: 0 in 0.408s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a2012fdc-89e4-4350-96a7-7d6358e8fb96 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a2012fdc-89e4-4350-96a7-7d6358e8fb96" returned: 0 in 0.163s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] <== create_volume: return (660ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:58:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7268a897-b9e6-4667-bfa2-5c87ccb703b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2012fdc-89e4-4350-96a7-7d6358e8fb96', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42af56a-5d3a-4d68-905e-5dc6cd47aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:06 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Volume volume-a2012fdc-89e4-4350-96a7-7d6358e8fb96 (a2012fdc-89e4-4350-96a7-7d6358e8fb96): created successfully
Sep 10 13:58:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42af56a-5d3a-4d68-905e-5dc6cd47aeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Flow 'volume_create_manager' (7d12a63b-7010-493c-9747-e8ebf5df5b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:58:07 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-6bcde257-54ba-4250-a9f2-7019cd0f27a8 tempest-VolumesTestJSON-535572934 None] Created volume successfully.
Sep 10 13:58:08 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Flow 'volume_create_manager' (b7fcd4b4-d733-4c39-b985-84959e2c7018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec9cb31-c39e-4d5b-b08a-b068f0733f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec9cb31-c39e-4d5b-b08a-b068f0733f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1876512790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b09242f-92e4-4dcc-b820-020ab751b0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e704ca7af643cb9f411a5ebdc300c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:08Z,use_quota=True,user_id='c249bc1a11df4e688ba4d76fe08b479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (266919d0-1316-41a2-879d-4159a728163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (266919d0-1316-41a2-879d-4159a728163e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca0df51-51db-4c3e-843e-46eb785d9d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca0df51-51db-4c3e-843e-46eb785d9d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b09242f-92e4-4dcc-b820-020ab751b0f3', 'volume_name': 'volume-6b09242f-92e4-4dcc-b820-020ab751b0f3', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87a62a5-a4e8-4550-ad2c-7029c1ec93c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87a62a5-a4e8-4550-ad2c-7029c1ec93c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f504bec-1f81-4a05-a57d-b0d2d940c206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:08 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Volume 6b09242f-92e4-4dcc-b820-020ab751b0f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b09242f-92e4-4dcc-b820-020ab751b0f3', 'volume_size': 1}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1876512790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b09242f-92e4-4dcc-b820-020ab751b0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e704ca7af643cb9f411a5ebdc300c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:08Z,use_quota=True,user_id='c249bc1a11df4e688ba4d76fe08b479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Creating volume 6b09242f-92e4-4dcc-b820-020ab751b0f3 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:58:08 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:58:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6b09242f-92e4-4dcc-b820-020ab751b0f3 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:08 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=55, name=volume-6b09242f-92e4-4dcc-b820-020ab751b0f3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:58:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6b09242f-92e4-4dcc-b820-020ab751b0f3 1073741824" returned: 0 in 0.832s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6b09242f-92e4-4dcc-b820-020ab751b0f3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:09 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:09 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:58:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Flow 'volume_create_manager' (a2479f73-dd4e-4279-8e6a-1a5fc56f9234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:58:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b6e8cf-129b-4e0a-8540-d7f976a5bd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6b09242f-92e4-4dcc-b820-020ab751b0f3" returned: 0 in 0.763s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] <== create_volume: return (1659ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b6e8cf-129b-4e0a-8540-d7f976a5bd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-327908213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8d152b-77bb-40cb-bd0f-237ce2bb110d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bead765503484264a4bdb5c356eb6189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:09Z,use_quota=True,user_id='eeb5872a5ea44e1fb95670b62ec8b875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e440231c-1d93-4baf-83ef-ae2c41e8a863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e440231c-1d93-4baf-83ef-ae2c41e8a863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ac6671-1bba-425a-a87a-ed422bdb504a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ac6671-1bba-425a-a87a-ed422bdb504a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af8d152b-77bb-40cb-bd0f-237ce2bb110d', 'volume_name': 'volume-af8d152b-77bb-40cb-bd0f-237ce2bb110d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0716c352-32b1-46da-b786-7d980e236e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0716c352-32b1-46da-b786-7d980e236e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13a0a46-3354-4ac1-8ef5-47ed1995edff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:10 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Volume af8d152b-77bb-40cb-bd0f-237ce2bb110d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af8d152b-77bb-40cb-bd0f-237ce2bb110d', 'volume_size': 1}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-327908213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8d152b-77bb-40cb-bd0f-237ce2bb110d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bead765503484264a4bdb5c356eb6189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:09Z,use_quota=True,user_id='eeb5872a5ea44e1fb95670b62ec8b875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Creating volume af8d152b-77bb-40cb-bd0f-237ce2bb110d {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:58:10 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af8d152b-77bb-40cb-bd0f-237ce2bb110d 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:10 devstack quobyte-client[82845]: System call of process 94827 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:58:10 devstack quobyte-client[82845]: System call of process 94827 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:58:10 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=56, name=volume-af8d152b-77bb-40cb-bd0f-237ce2bb110d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f504bec-1f81-4a05-a57d-b0d2d940c206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b09242f-92e4-4dcc-b820-020ab751b0f3', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f71aaa-bb4b-4494-901c-2dc25ec61218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:10 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Volume volume-6b09242f-92e4-4dcc-b820-020ab751b0f3 (6b09242f-92e4-4dcc-b820-020ab751b0f3): created successfully
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f71aaa-bb4b-4494-901c-2dc25ec61218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Flow 'volume_create_manager' (b7fcd4b4-d733-4c39-b985-84959e2c7018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:58:10 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-70dba292-ba0a-4ac3-b7b7-af1422f37c17 tempest-AttachVolumeNegativeTest-183563189 None] Created volume successfully.
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af8d152b-77bb-40cb-bd0f-237ce2bb110d 1073741824" returned: 0 in 0.607s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af8d152b-77bb-40cb-bd0f-237ce2bb110d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af8d152b-77bb-40cb-bd0f-237ce2bb110d" returned: 0 in 0.331s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] <== create_volume: return (1003ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:58:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13a0a46-3354-4ac1-8ef5-47ed1995edff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af8d152b-77bb-40cb-bd0f-237ce2bb110d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd7786b-5f76-4099-a3f0-916a446319dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:11 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Volume volume-af8d152b-77bb-40cb-bd0f-237ce2bb110d (af8d152b-77bb-40cb-bd0f-237ce2bb110d): created successfully
Sep 10 13:58:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd7786b-5f76-4099-a3f0-916a446319dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Flow 'volume_create_manager' (a2479f73-dd4e-4279-8e6a-1a5fc56f9234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:58:11 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-5fd1513a-7c01-473b-b975-3668b4eeb801 tempest-VolumesTestJSON-535572934 None] Created volume successfully.
Sep 10 13:58:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Acquiring lock "cinder-af8d152b-77bb-40cb-bd0f-237ce2bb110d-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:58:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Lock "cinder-af8d152b-77bb-40cb-bd0f-237ce2bb110d-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:58:14 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Acquiring lock "cinder-quobyte-af8d152b-77bb-40cb-bd0f-237ce2bb110d" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:58:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Lock "cinder-quobyte-af8d152b-77bb-40cb-bd0f-237ce2bb110d" acquired by "delete_volume" :: waited 0.018s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:58:14 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[7669a411-36a9-4146-94b0-069f8935b083]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:58:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af8d152b-77bb-40cb-bd0f-237ce2bb110d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:14 devstack quobyte-client[82845]: System call of process 94837 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:58:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af8d152b-77bb-40cb-bd0f-237ce2bb110d" returned: 0 in 0.771s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af8d152b-77bb-40cb-bd0f-237ce2bb110d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af8d152b-77bb-40cb-bd0f-237ce2bb110d" returned: 0 in 0.391s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Lock "cinder-quobyte-af8d152b-77bb-40cb-bd0f-237ce2bb110d" released by "delete_volume" :: held 1.416s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:58:15 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Created reservations ['8fc56a64-8620-4679-b040-22c83611e36b', '0a4c3db3-92f9-408c-8678-6cee54270033', '2541f897-9d39-4674-9759-fe727ab44f6d', '68080a3e-1885-44ec-80ac-211b74ed2078'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:58:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:58:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:58:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:16 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Acquiring lock "cinder-a2012fdc-89e4-4350-96a7-7d6358e8fb96-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:58:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-fcebc885-1d9b-4fab-a82d-47d2a5aeb400 req-0f3ecc40-0122-450f-920e-fcd0795755d1 tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-fcebc885-1d9b-4fab-a82d-47d2a5aeb400 req-0f3ecc40-0122-450f-920e-fcd0795755d1 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:16 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e85c7a-a4a6-441d-848c-698fa6572f02]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:58:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.622s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-fcebc885-1d9b-4fab-a82d-47d2a5aeb400 req-0f3ecc40-0122-450f-920e-fcd0795755d1 tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6b09242f-92e4-4dcc-b820-020ab751b0f3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:16 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:58:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Lock "cinder-a2012fdc-89e4-4350-96a7-7d6358e8fb96-delete_volume" acquired by "delete_volume" :: waited 0.419s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:58:17 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Deleted volume successfully.
Sep 10 13:58:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bb211644-7d47-43a2-b2b3-c0a1b99304e1 tempest-VolumesTestJSON-535572934 None] Lock "cinder-af8d152b-77bb-40cb-bd0f-237ce2bb110d-delete_volume" released by "delete_volume" :: held 3.500s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:58:17 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Acquiring lock "cinder-quobyte-a2012fdc-89e4-4350-96a7-7d6358e8fb96" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:58:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Lock "cinder-quobyte-a2012fdc-89e4-4350-96a7-7d6358e8fb96" acquired by "delete_volume" :: waited 0.035s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:58:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-fcebc885-1d9b-4fab-a82d-47d2a5aeb400 req-0f3ecc40-0122-450f-920e-fcd0795755d1 tempest-AttachVolumeNegativeTest-183563189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6b09242f-92e4-4dcc-b820-020ab751b0f3" returned: 0 in 0.770s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-fcebc885-1d9b-4fab-a82d-47d2a5aeb400 req-0f3ecc40-0122-450f-920e-fcd0795755d1 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.813s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:17 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7f87f8-abbb-4975-b395-65a2bf4237b4]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:58:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a2012fdc-89e4-4350-96a7-7d6358e8fb96 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-fcebc885-1d9b-4fab-a82d-47d2a5aeb400 req-0f3ecc40-0122-450f-920e-fcd0795755d1 tempest-AttachVolumeNegativeTest-183563189 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-6b09242f-92e4-4dcc-b820-020ab751b0f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba3547a1-bf2d-45cf-81a6-927835ea0e51', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:58:18 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-fcebc885-1d9b-4fab-a82d-47d2a5aeb400 req-0f3ecc40-0122-450f-920e-fcd0795755d1 tempest-AttachVolumeNegativeTest-183563189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:18 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-fcebc885-1d9b-4fab-a82d-47d2a5aeb400 req-0f3ecc40-0122-450f-920e-fcd0795755d1 tempest-AttachVolumeNegativeTest-183563189 None] attachment_update completed successfully.
Sep 10 13:58:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a2012fdc-89e4-4350-96a7-7d6358e8fb96" returned: 0 in 0.854s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a2012fdc-89e4-4350-96a7-7d6358e8fb96 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a2012fdc-89e4-4350-96a7-7d6358e8fb96" returned: 0 in 0.111s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Lock "cinder-quobyte-a2012fdc-89e4-4350-96a7-7d6358e8fb96" released by "delete_volume" :: held 1.128s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:58:19 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Created reservations ['07c60f07-58d0-47bd-99b9-2f3deb1f3015', '9ab131f8-bc7d-4c77-812a-f34c4478fd45', '6443f137-6f97-4cb5-93b1-3576e14ea471', '6a5d4041-abda-448d-9403-32b03b877659'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:58:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:58:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:58:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Acquiring lock "cinder-a92e71b1-6806-41d5-95a4-dfb6db03b828-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:58:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.527s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:20 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:58:20 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Deleted volume successfully.
Sep 10 13:58:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Lock "cinder-a92e71b1-6806-41d5-95a4-dfb6db03b828-delete_volume" acquired by "delete_volume" :: waited 0.339s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:58:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-13a81bf6-5607-4554-9b43-e7d8638451c5 tempest-VolumesTestJSON-535572934 None] Lock "cinder-a2012fdc-89e4-4350-96a7-7d6358e8fb96-delete_volume" released by "delete_volume" :: held 3.527s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:58:20 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Acquiring lock "cinder-quobyte-a92e71b1-6806-41d5-95a4-dfb6db03b828" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:58:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Lock "cinder-quobyte-a92e71b1-6806-41d5-95a4-dfb6db03b828" acquired by "delete_volume" :: waited 0.021s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:58:20 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5d4f86-63c2-4451-94f3-848845cc18af]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:58:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a92e71b1-6806-41d5-95a4-dfb6db03b828 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a92e71b1-6806-41d5-95a4-dfb6db03b828" returned: 0 in 0.813s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a92e71b1-6806-41d5-95a4-dfb6db03b828 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a92e71b1-6806-41d5-95a4-dfb6db03b828" returned: 0 in 0.136s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Lock "cinder-quobyte-a92e71b1-6806-41d5-95a4-dfb6db03b828" released by "delete_volume" :: held 1.277s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:58:22 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Created reservations ['529abdfa-3cf3-44d2-aca4-f869656c67a8', 'af77aa89-dc3d-46df-afd8-0f2cc49872d6', 'e6028baa-a9af-4368-a6bf-7f9e96c67966', 'd2b0d1b1-086c-4fbb-b5c4-2ecc374797d1'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:58:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:22 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:58:22 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:58:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.096s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:22 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:58:23 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Deleted volume successfully.
Sep 10 13:58:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-9b5e7987-7031-4f46-98a9-303cec4e64ca tempest-VolumesTestJSON-535572934 None] Lock "cinder-a92e71b1-6806-41d5-95a4-dfb6db03b828-delete_volume" released by "delete_volume" :: held 2.674s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:58:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:58:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:58:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:58:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.226s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:58:32 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Flow 'volume_create_manager' (4e7c7e7f-b7f6-4dbf-8dfb-7e05292afe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea3544c-9a0c-43b1-950d-280c4ca7ffc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea3544c-9a0c-43b1-950d-280c4ca7ffc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-855830913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb39a741-bd6b-4b3a-9d95-5eb3ec863356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59467075b76b4203bdaecb0fac14b032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:32Z,use_quota=True,user_id='9aa1d9b81997416b81d1eec8c1f7f708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467ed9bd-454c-4da8-a4e7-1568bcd1343a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467ed9bd-454c-4da8-a4e7-1568bcd1343a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20bc4761-17f5-47a6-9cd3-05aefc12e85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20bc4761-17f5-47a6-9cd3-05aefc12e85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb39a741-bd6b-4b3a-9d95-5eb3ec863356', 'volume_name': 'volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a24b562-1ea6-4575-a7d2-f6f8856298c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a24b562-1ea6-4575-a7d2-f6f8856298c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc33174b-03d4-420b-ad7d-1d36cee77bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:32 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Volume eb39a741-bd6b-4b3a-9d95-5eb3ec863356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356', 'volume_size': 1}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-855830913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb39a741-bd6b-4b3a-9d95-5eb3ec863356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59467075b76b4203bdaecb0fac14b032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:32Z,use_quota=True,user_id='9aa1d9b81997416b81d1eec8c1f7f708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Creating volume eb39a741-bd6b-4b3a-9d95-5eb3ec863356 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:58:32 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:58:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:33 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=57, name=volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:58:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356 1073741824" returned: 0 in 0.530s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356" returned: 0 in 0.133s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] <== create_volume: return (758ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:58:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:33 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=43,cinder:SELECT=33,cinder:INSERT=13,cinder:DELETE=4 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:58:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc33174b-03d4-420b-ad7d-1d36cee77bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5551a3-123e-4a8c-972d-0128b40732b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:33 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=43,cinder:UPDATE=61,cinder:DELETE=6,cinder:INSERT=7 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:58:33 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Volume volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356 (eb39a741-bd6b-4b3a-9d95-5eb3ec863356): created successfully
Sep 10 13:58:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5551a3-123e-4a8c-972d-0128b40732b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Flow 'volume_create_manager' (4e7c7e7f-b7f6-4dbf-8dfb-7e05292afe60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:58:34 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-ebc28600-4d5f-4890-8722-78141e49b60e tempest-GroupsV320Test-405503962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:34 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-ebc28600-4d5f-4890-8722-78141e49b60e tempest-GroupsV320Test-405503962 None] Group tempest-GroupsV320Test-Group-650957187: creating
Sep 10 13:58:34 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-915d5e7d-1ae8-4ca1-b0ed-11927758776e tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Created volume successfully.
Sep 10 13:58:34 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-ebc28600-4d5f-4890-8722-78141e49b60e tempest-GroupsV320Test-405503962 None] Group tempest-GroupsV320Test-Group-650957187: created successfully
Sep 10 13:58:34 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-ebc28600-4d5f-4890-8722-78141e49b60e tempest-GroupsV320Test-405503962 None] Create group completed successfully.
Sep 10 13:58:35 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-047505ef-1967-47e0-827b-b07cf46a7ee9 tempest-GroupsV320Test-405503962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:35 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-047505ef-1967-47e0-827b-b07cf46a7ee9 tempest-GroupsV320Test-405503962 None] Created reservations ['7716a29e-4178-4389-aaae-6971ef7799be'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:58:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-047505ef-1967-47e0-827b-b07cf46a7ee9 tempest-GroupsV320Test-405503962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-047505ef-1967-47e0-827b-b07cf46a7ee9 tempest-GroupsV320Test-405503962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-047505ef-1967-47e0-827b-b07cf46a7ee9 tempest-GroupsV320Test-405503962 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:58:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-047505ef-1967-47e0-827b-b07cf46a7ee9 tempest-GroupsV320Test-405503962 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:58:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-047505ef-1967-47e0-827b-b07cf46a7ee9 tempest-GroupsV320Test-405503962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-047505ef-1967-47e0-827b-b07cf46a7ee9 tempest-GroupsV320Test-405503962 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-047505ef-1967-47e0-827b-b07cf46a7ee9 tempest-GroupsV320Test-405503962 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.121s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:36 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-047505ef-1967-47e0-827b-b07cf46a7ee9 tempest-GroupsV320Test-405503962 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:58:36 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-047505ef-1967-47e0-827b-b07cf46a7ee9 tempest-GroupsV320Test-405503962 None] Delete group completed successfully.
Sep 10 13:58:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-ad55d7d5-9be9-4582-955a-2fd8656e1d91 req-83111bdd-7a1f-4140-85eb-d403f7e0a7ea tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-ad55d7d5-9be9-4582-955a-2fd8656e1d91 req-83111bdd-7a1f-4140-85eb-d403f7e0a7ea tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:38 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc328d7f-c3b9-4260-a64c-be3b94e7efa4]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:58:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-ad55d7d5-9be9-4582-955a-2fd8656e1d91 req-83111bdd-7a1f-4140-85eb-d403f7e0a7ea tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-ad55d7d5-9be9-4582-955a-2fd8656e1d91 req-83111bdd-7a1f-4140-85eb-d403f7e0a7ea tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356" returned: 0 in 0.519s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-ad55d7d5-9be9-4582-955a-2fd8656e1d91 req-83111bdd-7a1f-4140-85eb-d403f7e0a7ea tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.599s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-ad55d7d5-9be9-4582-955a-2fd8656e1d91 req-83111bdd-7a1f-4140-85eb-d403f7e0a7ea tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b34fa0d-5d57-4afc-9fa5-2181d7e9a037', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 13:58:39 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-ad55d7d5-9be9-4582-955a-2fd8656e1d91 req-83111bdd-7a1f-4140-85eb-d403f7e0a7ea tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:39 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-ad55d7d5-9be9-4582-955a-2fd8656e1d91 req-83111bdd-7a1f-4140-85eb-d403f7e0a7ea tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] attachment_update completed successfully.
Sep 10 13:58:44 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Flow 'volume_create_manager' (148f2a12-1636-456a-acad-730d062da234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff05b96-ae13-461d-951c-87e76af0ebae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff05b96-ae13-461d-951c-87e76af0ebae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1589868217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a92e4d-b7b6-4ebd-9872-265fc51c3739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70eb394138994fe1a949afe78b701a6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:45Z,use_quota=True,user_id='1b8b582383044261857951d47b004a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5de9719-e8a7-4d80-879e-bc9a6f09bc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5de9719-e8a7-4d80-879e-bc9a6f09bc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81d0082-6780-4c95-bbb5-997bf52141eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81d0082-6780-4c95-bbb5-997bf52141eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a92e4d-b7b6-4ebd-9872-265fc51c3739', 'volume_name': 'volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d079da38-bb23-4cf7-ab9a-69adedad74ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d079da38-bb23-4cf7-ab9a-69adedad74ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698fc394-4e3f-437c-a951-a4cfad2584b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:44 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Volume 82a92e4d-b7b6-4ebd-9872-265fc51c3739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739', 'volume_size': 1}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1589868217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a92e4d-b7b6-4ebd-9872-265fc51c3739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70eb394138994fe1a949afe78b701a6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:58:45Z,use_quota=True,user_id='1b8b582383044261857951d47b004a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Creating volume 82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:44 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:58:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:58:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:58:45 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:58:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:45 devstack quobyte-client[82845]: System call of process 95354 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:58:45 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=58, name=volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:58:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739 1073741824" returned: 0 in 0.535s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739" returned: 0 in 0.134s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] <== create_volume: return (749ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:58:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:46 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698fc394-4e3f-437c-a951-a4cfad2584b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:46 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b58cbbf-56f7-4d7d-9b4c-f2580003076b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:58:46 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Volume volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739 (82a92e4d-b7b6-4ebd-9872-265fc51c3739): created successfully
Sep 10 13:58:46 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b58cbbf-56f7-4d7d-9b4c-f2580003076b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:58:46 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Flow 'volume_create_manager' (148f2a12-1636-456a-acad-730d062da234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:58:46 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-7f4e8466-ce66-4391-8a67-527b17bbc666 tempest-SnapshotsActionsTest-557486824 None] Created volume successfully.
Sep 10 13:58:47 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] Creating offline snapshot ef95a8b4-7d2b-48e9-babf-b7a4041db283 of volume 82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 13:58:47 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f9a0f2-b86e-4ed7-a9d3-11b1ff40e1d7]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:58:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739" returned: 0 in 0.563s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:48 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=59, name=volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:58:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 1G" returned: 0 in 0.315s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): qemu-img rebase -u -b volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:48 devstack quobyte-client[82845]: System call of process 95364 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:58:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] CMD "qemu-img rebase -u -b volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283" returned: 0 in 0.194s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:58:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283" returned: 0 in 0.113s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 13:58:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283" returned: 0 in 0.099s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.info" returned: 0 in 0.104s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:58:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.info" returned: 0 in 0.102s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:49 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-7264a1de-4769-4e59-b99c-8bde07acca4d tempest-SnapshotsActionsTest-557486824 None] Create snapshot completed successfully
Sep 10 13:58:49 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-607ed262-1b98-4b2a-9b11-bd5a75231a52 req-bddf6c81-748b-4868-9dab-817fba26789c tempest-AttachVolumeNegativeTest-183563189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:49 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-607ed262-1b98-4b2a-9b11-bd5a75231a52 req-bddf6c81-748b-4868-9dab-817fba26789c tempest-AttachVolumeNegativeTest-183563189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:49 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-607ed262-1b98-4b2a-9b11-bd5a75231a52 req-bddf6c81-748b-4868-9dab-817fba26789c tempest-AttachVolumeNegativeTest-183563189 None] Terminate volume connection completed successfully.
Sep 10 13:58:49 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-607ed262-1b98-4b2a-9b11-bd5a75231a52 req-bddf6c81-748b-4868-9dab-817fba26789c tempest-AttachVolumeNegativeTest-183563189 None] Deleting attachment ba3547a1-bf2d-45cf-81a6-927835ea0e51. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:58:51 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] Creating offline snapshot 6e0e17b1-d442-4963-bc87-1def7d7ceaa3 of volume 82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 13:58:51 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[c994ce5e-11af-4d85-a44b-a5d489bcbd0a]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:58:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283" returned: 0 in 0.570s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:58:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:51 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=61, name=volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:58:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3 1G" returned: 0 in 0.303s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): qemu-img rebase -u -b volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] CMD "qemu-img rebase -u -b volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3" returned: 0 in 0.133s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:58:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3" returned: 0 in 0.300s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 13:58:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3" returned: 0 in 0.193s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:53 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-bada983b-ecc3-4a7f-b6ee-685191a16a15 tempest-SnapshotsActionsTest-557486824 None] Create snapshot completed successfully
Sep 10 13:58:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Acquiring lock "cinder-6e0e17b1-d442-4963-bc87-1def7d7ceaa3-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:58:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-6e0e17b1-d442-4963-bc87-1def7d7ceaa3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:58:54 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Acquiring lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:58:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:58:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Acquiring lock "cinder-quobyte-6e0e17b1-d442-4963-bc87-1def7d7ceaa3" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:58:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-6e0e17b1-d442-4963-bc87-1def7d7ceaa3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:58:54 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Deleting offline snapshot 6e0e17b1-d442-4963-bc87-1def7d7ceaa3 of volume 82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 13:58:54 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] snapshot_file for this snap is: volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 13:58:54 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[74426609-4250-426f-9d85-0b830f44e36a]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:58:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3" returned: 0 in 0.594s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:58:55 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[288a0b8a-3d2e-4e4b-9c40-0fc19ab924b7]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:58:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283" returned: 0 in 0.562s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:58:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:56 devstack quobyte-client[82845]: System call of process 95437 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:58:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3" returned: 0 in 0.406s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.6e0e17b1-d442-4963-bc87-1def7d7ceaa3" returned: 0 in 0.177s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:56 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-6e0e17b1-d442-4963-bc87-1def7d7ceaa3" released by "_delete_snapshot" :: held 2.181s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:58:56 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" released by "delete_snapshot" :: held 2.239s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:58:57 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Created reservations ['b3bf582d-d74c-4c67-8e02-07c55ddfbe9e', 'fb358a51-46f3-4643-8445-d4515df3be04', '0360175d-ffb3-4679-a841-2a3f2fd69f36', '64a77e1b-7ac1-41b8-9919-22cc94a2f6d9'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:58:57 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Delete snapshot completed successfully.
Sep 10 13:58:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6427ccd-abac-46af-bca5-9bd6cbeeaa92 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-6e0e17b1-d442-4963-bc87-1def7d7ceaa3-delete_snapshot" released by "delete_snapshot" :: held 2.989s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:58:58 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:58:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:58:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:58:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] Creating offline snapshot a96beec4-824c-40d4-bafb-ccabb3661916 of volume 82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 13:58:58 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[243d9515-64c3-4fd6-a70f-39ac5fbdd3ee]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:58:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:58 devstack quobyte-client[82845]: System call of process 95442 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:58:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283" returned: 0 in 0.432s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:58:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:58 devstack quobyte-client[82845]: System call of process 95445 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:58:58 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=62, name=volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:58:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916 1G" returned: 0 in 0.304s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): qemu-img rebase -u -b volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:59 devstack quobyte-client[82845]: System call of process 95448 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:58:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] CMD "qemu-img rebase -u -b volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916" returned: 0 in 0.143s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:58:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916" returned: 0 in 0.078s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 13:58:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:58:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916" returned: 0 in 0.117s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:58:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.334s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:58:59 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-70120d95-510d-4b70-87be-a6cb2a807e47 tempest-SnapshotsActionsTest-557486824 None] Create snapshot completed successfully
Sep 10 13:59:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Acquiring lock "cinder-a96beec4-824c-40d4-bafb-ccabb3661916-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-a96beec4-824c-40d4-bafb-ccabb3661916-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:00 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Acquiring lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Acquiring lock "cinder-quobyte-a96beec4-824c-40d4-bafb-ccabb3661916" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-a96beec4-824c-40d4-bafb-ccabb3661916" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Deleting offline snapshot a96beec4-824c-40d4-bafb-ccabb3661916 of volume 82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 13:59:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] snapshot_file for this snap is: volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 13:59:00 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab4bef8-b6d7-4276-8602-7c5337ff7f68]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916" returned: 0 in 0.446s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:59:01 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90c2314-9e30-471a-935c-f6e5ca931122]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283" returned: 0 in 0.419s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:59:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:01 devstack quobyte-client[82845]: System call of process 95463 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:59:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916" returned: 0 in 0.281s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a96beec4-824c-40d4-bafb-ccabb3661916" returned: 0 in 0.087s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:02 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-a96beec4-824c-40d4-bafb-ccabb3661916" released by "_delete_snapshot" :: held 1.508s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:02 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" released by "delete_snapshot" :: held 1.542s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:02 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Created reservations ['49afe045-94a9-4622-a74f-f429dc7deb9c', '735c3a7f-c8d4-478f-a2df-1c6bce5adf3c', 'be0aa19c-b272-4f73-82a5-243ed6748688', 'e1e4272a-9155-45a5-920b-e07bfa7fde01'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:59:02 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Delete snapshot completed successfully.
Sep 10 13:59:02 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-acbf2106-87b6-452f-a89e-4517d2df0a79 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-a96beec4-824c-40d4-bafb-ccabb3661916-delete_snapshot" released by "delete_snapshot" :: held 2.037s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:03 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] Creating offline snapshot a3836134-725e-4915-8a05-a78579133dc1 of volume 82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 13:59:03 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc521ecf-1fa5-4a92-ad42-de02ded319ac]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283" returned: 0 in 0.409s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:59:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:04 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=63, name=volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:59:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "cinder-6b09242f-92e4-4dcc-b820-020ab751b0f3-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1 1G" returned: 0 in 0.585s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): qemu-img rebase -u -b volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Lock "cinder-6b09242f-92e4-4dcc-b820-020ab751b0f3-delete_volume" acquired by "delete_volume" :: waited 0.286s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] CMD "qemu-img rebase -u -b volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1" returned: 0 in 0.366s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:04 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:59:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1" returned: 0 in 0.286s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 13:59:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:05 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "cinder-quobyte-6b09242f-92e4-4dcc-b820-020ab751b0f3" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1" returned: 0 in 0.297s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Lock "cinder-quobyte-6b09242f-92e4-4dcc-b820-020ab751b0f3" acquired by "delete_volume" :: waited 0.143s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:05 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3d63a8-2f39-4297-8dbf-6b28f0767408]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6b09242f-92e4-4dcc-b820-020ab751b0f3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:05 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-c6be0f48-694b-4310-9f0b-df5d2615d337 tempest-SnapshotsActionsTest-557486824 None] Create snapshot completed successfully
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6b09242f-92e4-4dcc-b820-020ab751b0f3" returned: 0 in 0.505s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6b09242f-92e4-4dcc-b820-020ab751b0f3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6b09242f-92e4-4dcc-b820-020ab751b0f3" returned: 0 in 0.084s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Lock "cinder-quobyte-6b09242f-92e4-4dcc-b820-020ab751b0f3" released by "delete_volume" :: held 0.940s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Created reservations ['f8f52d6d-cd51-4399-b7bc-b77f2c8b7083', 'bdcc9327-9ad4-4fd1-9c1b-2f603644b178', '33d14afb-8c36-49cc-aa0c-4747472770e9', '0cfaaf59-5cc1-4328-9eb1-fd051d6db139'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Acquiring lock "cinder-a3836134-725e-4915-8a05-a78579133dc1-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-a3836134-725e-4915-8a05-a78579133dc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:06 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Acquiring lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Acquiring lock "cinder-quobyte-a3836134-725e-4915-8a05-a78579133dc1" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-a3836134-725e-4915-8a05-a78579133dc1" acquired by "_delete_snapshot" :: waited 0.132s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Deleting offline snapshot a3836134-725e-4915-8a05-a78579133dc1 of volume 82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 13:59:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] snapshot_file for this snap is: volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 13:59:07 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[a280f540-16a2-467b-aab2-25f7ceb1f15d]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.314s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:07 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:59:07 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Deleted volume successfully.
Sep 10 13:59:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cb5824ff-135d-43f5-af29-7699450ae9d1 tempest-AttachVolumeNegativeTest-183563189 None] Lock "cinder-6b09242f-92e4-4dcc-b820-020ab751b0f3-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:07 devstack quobyte-client[82845]: System call of process 95485 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:59:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1" returned: 0 in 0.499s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:59:07 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e54bb30-60b0-4fe4-9ad7-b306cd459514]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:08 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "cinder-993b7c52-5eae-442b-aa15-2fe20eff5461-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:08 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Lock "cinder-993b7c52-5eae-442b-aa15-2fe20eff5461-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283" returned: 0 in 0.650s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:59:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:08 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:08 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "cinder-quobyte-993b7c52-5eae-442b-aa15-2fe20eff5461" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1" returned: 0 in 0.497s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.a3836134-725e-4915-8a05-a78579133dc1" returned: 0 in 0.311s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:09 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Lock "cinder-quobyte-993b7c52-5eae-442b-aa15-2fe20eff5461" acquired by "delete_volume" :: waited 0.383s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:09 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10552ca-43b6-45e9-99a0-bbd0cfb3a513]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-993b7c52-5eae-442b-aa15-2fe20eff5461 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:09 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-a3836134-725e-4915-8a05-a78579133dc1" released by "_delete_snapshot" :: held 2.348s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:09 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" released by "delete_snapshot" :: held 2.596s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:09 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Created reservations ['14ca3597-fe2e-469a-99db-8d6fec7b7c0c', 'ede5ba0c-7f6c-4bc8-88f1-a05e7a5d3d7f', 'bc883838-c920-4b7a-9f85-6efebba47232', 'dbb198ac-9ef5-432b-8521-913d646b20e9'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:59:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-993b7c52-5eae-442b-aa15-2fe20eff5461" returned: 0 in 0.694s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-993b7c52-5eae-442b-aa15-2fe20eff5461 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-993b7c52-5eae-442b-aa15-2fe20eff5461" returned: 0 in 0.216s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Lock "cinder-quobyte-993b7c52-5eae-442b-aa15-2fe20eff5461" released by "delete_volume" :: held 1.086s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:10 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Delete snapshot completed successfully.
Sep 10 13:59:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-35b8266d-206a-431c-ae97-f64a85403e1c tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-a3836134-725e-4915-8a05-a78579133dc1-delete_snapshot" released by "delete_snapshot" :: held 3.601s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:10 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Created reservations ['d777dbb9-a7fd-42eb-99f1-716eb0024052', '627c9883-6f78-4435-b9c6-b673b739b701', '6bb195cf-27aa-410d-9bdb-30a21b183125', '967c2410-eb9f-4a40-97b6-67ebc82b40d2'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:59:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:59:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:59:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.082s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:10 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:59:10 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Deleted volume successfully.
Sep 10 13:59:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-52197b56-a3ce-49b8-93f2-5a04754ad6aa tempest-AttachVolumeNegativeTest-183563189 None] Lock "cinder-993b7c52-5eae-442b-aa15-2fe20eff5461-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:11 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-4edd2e93-3ddb-462a-9128-99c7b236afe2 req-28be0de6-024c-434d-a12e-67deb2e8be77 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:11 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "cinder-223ebeef-46ac-4fe2-9c17-5aa76c14be3a-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:11 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:11 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-4edd2e93-3ddb-462a-9128-99c7b236afe2 req-28be0de6-024c-434d-a12e-67deb2e8be77 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:11 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-4edd2e93-3ddb-462a-9128-99c7b236afe2 req-28be0de6-024c-434d-a12e-67deb2e8be77 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Terminate volume connection completed successfully.
Sep 10 13:59:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-4edd2e93-3ddb-462a-9128-99c7b236afe2 req-28be0de6-024c-434d-a12e-67deb2e8be77 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Deleting attachment 6b34fa0d-5d57-4afc-9fa5-2181d7e9a037. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 13:59:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] Creating offline snapshot ae0860bd-088f-416a-84cf-371ca7660537 of volume 82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 13:59:11 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cc96cf-9e60-4057-9fe6-ba5a42682a61]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:12 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Lock "cinder-223ebeef-46ac-4fe2-9c17-5aa76c14be3a-delete_volume" acquired by "delete_volume" :: waited 0.218s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:12 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:12 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "cinder-quobyte-223ebeef-46ac-4fe2-9c17-5aa76c14be3a" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283" returned: 0 in 0.561s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:59:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:12 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Lock "cinder-quobyte-223ebeef-46ac-4fe2-9c17-5aa76c14be3a" acquired by "delete_volume" :: waited 0.148s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:12 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=64, name=volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:59:12 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[377c6def-e5db-46d5-a3fb-3cd2fa5b79ad]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537 1G" returned: 0 in 0.337s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): qemu-img rebase -u -b volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:13 devstack quobyte-client[82845]: System call of process 95542 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:59:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] CMD "qemu-img rebase -u -b volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537" returned: 0 in 0.219s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:13 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:59:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537" returned: 0 in 0.113s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:13 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 13:59:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a" returned: 0 in 0.617s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537" returned: 0 in 0.220s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.732s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-223ebeef-46ac-4fe2-9c17-5aa76c14be3a" returned: 0 in 0.360s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:13 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-d7b54729-04a0-4f2b-8626-6bb45e8218d5 tempest-SnapshotsActionsTest-557486824 None] Create snapshot completed successfully
Sep 10 13:59:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Lock "cinder-quobyte-223ebeef-46ac-4fe2-9c17-5aa76c14be3a" released by "delete_volume" :: held 1.288s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Created reservations ['f836478b-b776-4a57-bbad-bdd70291628f', 'fd1d553f-f73d-4514-a3c3-bdf9abdc6b0e', '401ae89e-28be-4d1e-849e-e489c0dc28c3', 'c25f7fbb-eef8-4fd7-95e1-5b91fce6b886'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Acquiring lock "cinder-eb39a741-bd6b-4b3a-9d95-5eb3ec863356-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Lock "cinder-eb39a741-bd6b-4b3a-9d95-5eb3ec863356-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:14 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Acquiring lock "cinder-quobyte-eb39a741-bd6b-4b3a-9d95-5eb3ec863356" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.376s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Lock "cinder-quobyte-eb39a741-bd6b-4b3a-9d95-5eb3ec863356" acquired by "delete_volume" :: waited 0.080s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:14 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Deleted volume successfully.
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa66154-0c23-47d2-9c32-e107cce36cdb]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dbc6f239-7496-4135-ad97-48e555448e7f tempest-AttachVolumeNegativeTest-183563189 None] Lock "cinder-223ebeef-46ac-4fe2-9c17-5aa76c14be3a-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Acquiring lock "cinder-ae0860bd-088f-416a-84cf-371ca7660537-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:15 devstack quobyte-client[82845]: System call of process 95551 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:59:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-ae0860bd-088f-416a-84cf-371ca7660537-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:15 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Acquiring lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Acquiring lock "cinder-quobyte-ae0860bd-088f-416a-84cf-371ca7660537" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356" returned: 0 in 0.629s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-ae0860bd-088f-416a-84cf-371ca7660537" acquired by "_delete_snapshot" :: waited 0.175s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Deleting offline snapshot ae0860bd-088f-416a-84cf-371ca7660537 of volume 82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 13:59:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] snapshot_file for this snap is: volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 13:59:15 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[5485e0a8-b00a-4222-8f9d-a55a8746b931]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eb39a741-bd6b-4b3a-9d95-5eb3ec863356" returned: 0 in 0.358s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Lock "cinder-quobyte-eb39a741-bd6b-4b3a-9d95-5eb3ec863356" released by "delete_volume" :: held 1.146s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:16 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Created reservations ['f21d645b-dbfc-49a7-83f1-0f5ca0bf3105', '43eb029f-2277-4cad-b24b-10161e92b811', 'f49f40f4-eceb-4afd-863c-d02fe8c9fcc8', '6207de19-e8da-4686-a5aa-460f01a5bec5'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:59:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:59:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:59:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537" returned: 0 in 0.769s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:59:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.183s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:16 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:59:16 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[4502a56a-36e9-4f68-ab7b-be1f3dcade7e]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:16 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Deleted volume successfully.
Sep 10 13:59:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-cc910620-12cf-45f6-aa34-c0d572a762e0 tempest-TestServerVolumeAttachScenarioOldVersion-1397039535 None] Lock "cinder-eb39a741-bd6b-4b3a-9d95-5eb3ec863356-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:17 devstack quobyte-client[82845]: System call of process 95559 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:59:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283" returned: 0 in 0.664s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:17 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:59:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537" returned: 0 in 0.398s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ae0860bd-088f-416a-84cf-371ca7660537" returned: 0 in 0.099s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-ae0860bd-088f-416a-84cf-371ca7660537" released by "_delete_snapshot" :: held 2.396s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" released by "delete_snapshot" :: held 2.583s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:19 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Created reservations ['7fe1adab-c5c4-437d-869e-778c3124c264', 'bdad14c7-6f79-4dbc-b378-7cc25aa1e98d', '3eb5ea9c-a084-4d7c-b6e7-095e5c4be24f', '277dcc30-b15a-4d97-b5cb-4f2e46b36c69'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:59:19 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Delete snapshot completed successfully.
Sep 10 13:59:19 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bfd1b8e8-4d01-4017-9895-b3e60aba8c79 tempest-SnapshotsActionsTest-888478196 None] Lock "cinder-ae0860bd-088f-416a-84cf-371ca7660537-delete_snapshot" released by "delete_snapshot" :: held 4.253s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Acquiring lock "cinder-ef95a8b4-7d2b-48e9-babf-b7a4041db283-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Lock "cinder-ef95a8b4-7d2b-48e9-babf-b7a4041db283-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:20 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Acquiring lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Acquiring lock "cinder-quobyte-ef95a8b4-7d2b-48e9-babf-b7a4041db283" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Lock "cinder-quobyte-ef95a8b4-7d2b-48e9-babf-b7a4041db283" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Deleting offline snapshot ef95a8b4-7d2b-48e9-babf-b7a4041db283 of volume 82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 13:59:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] snapshot_file for this snap is: volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 13:59:20 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd8d6f3-4c47-4df8-b5fa-5b316ac3bf64]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283" returned: 0 in 0.797s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:59:21 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea371633-185d-4132-aacb-97530909377f]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739" returned: 0 in 0.672s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283" returned: 0 in 0.294s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739.ef95a8b4-7d2b-48e9-babf-b7a4041db283" returned: 0 in 0.257s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Lock "cinder-quobyte-ef95a8b4-7d2b-48e9-babf-b7a4041db283" released by "_delete_snapshot" :: held 2.522s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" released by "delete_snapshot" :: held 2.551s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:23 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Created reservations ['1b1a3110-af4e-4627-936b-88cf9de45eda', '853a5df9-9f35-4921-b664-50a20299972f', '361c4d48-bb83-4478-a8a4-2978119b61a4', '45caf17a-7db0-4e08-b112-4571a90c457e'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:59:24 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Delete snapshot completed successfully.
Sep 10 13:59:24 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-082c4155-51f4-44ae-b55a-3b4ecba912bb tempest-SnapshotsActionsTest-557486824 None] Lock "cinder-ef95a8b4-7d2b-48e9-babf-b7a4041db283-delete_snapshot" released by "delete_snapshot" :: held 3.244s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Acquiring lock "cinder-82a92e4d-b7b6-4ebd-9872-265fc51c3739-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Lock "cinder-82a92e4d-b7b6-4ebd-9872-265fc51c3739-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:25 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Acquiring lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" acquired by "delete_volume" :: waited 0.011s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:25 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[7385ac05-5b69-4dcf-abc2-d4251d85dd91]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739" returned: 0 in 0.639s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-82a92e4d-b7b6-4ebd-9872-265fc51c3739" returned: 0 in 0.156s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:26 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Lock "cinder-quobyte-82a92e4d-b7b6-4ebd-9872-265fc51c3739" released by "delete_volume" :: held 1.009s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:26 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Created reservations ['b98a9b41-0b73-4d8c-88b4-04d5f8d6b8ba', '1b92b593-7390-446f-b490-2c7311e66b29', '164d6a5d-7941-4a0a-8e12-9bb6acd6fc37', '71b59a8b-045e-4dd3-8475-59ebb80c5894'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:59:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:59:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:59:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.098s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:27 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:59:27 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Deleted volume successfully.
Sep 10 13:59:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-af2aa9fc-0507-4fbd-92bf-b11d2d505202 tempest-SnapshotsActionsTest-557486824 None] Lock "cinder-82a92e4d-b7b6-4ebd-9872-265fc51c3739-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 13:59:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:59:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:59:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.172s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:29 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:59:31 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Flow 'volume_create_manager' (7042cef0-035d-409c-836e-0dea35b09ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c34fc5-01e3-48ff-bd36-52097beeec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c34fc5-01e3-48ff-bd36-52097beeec94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2082607243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60fa5016-759d-4c01-8dce-b244abc84774,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4289c89bb65749e78785d441d33ac77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:31Z,use_quota=True,user_id='068c8c49a3124668adcfa9351fc0113c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc9d212-4713-4c3e-b752-ae7bfb8f24a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc9d212-4713-4c3e-b752-ae7bfb8f24a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94497f0f-d0c3-4d6d-a37e-f59b78a5beb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94497f0f-d0c3-4d6d-a37e-f59b78a5beb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60fa5016-759d-4c01-8dce-b244abc84774', 'volume_name': 'volume-60fa5016-759d-4c01-8dce-b244abc84774', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b60887-c94f-4fe7-9843-e747053cc3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b60887-c94f-4fe7-9843-e747053cc3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cab167d-ab00-41b9-91bd-9c8a6bb0f575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:31 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Volume 60fa5016-759d-4c01-8dce-b244abc84774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60fa5016-759d-4c01-8dce-b244abc84774', 'volume_size': 1}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2082607243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60fa5016-759d-4c01-8dce-b244abc84774,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4289c89bb65749e78785d441d33ac77b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:31Z,use_quota=True,user_id='068c8c49a3124668adcfa9351fc0113c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Creating volume 60fa5016-759d-4c01-8dce-b244abc84774 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:59:31 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:59:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-60fa5016-759d-4c01-8dce-b244abc84774 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:31 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=65, name=volume-60fa5016-759d-4c01-8dce-b244abc84774, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:59:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-60fa5016-759d-4c01-8dce-b244abc84774 1073741824" returned: 0 in 0.599s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-60fa5016-759d-4c01-8dce-b244abc84774 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-60fa5016-759d-4c01-8dce-b244abc84774" returned: 0 in 0.193s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] <== create_volume: return (947ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:59:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cab167d-ab00-41b9-91bd-9c8a6bb0f575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60fa5016-759d-4c01-8dce-b244abc84774', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f29b04-9f3c-4ecd-99d3-ef1c621ca090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:32 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Volume volume-60fa5016-759d-4c01-8dce-b244abc84774 (60fa5016-759d-4c01-8dce-b244abc84774): created successfully
Sep 10 13:59:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f29b04-9f3c-4ecd-99d3-ef1c621ca090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Flow 'volume_create_manager' (7042cef0-035d-409c-836e-0dea35b09ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:59:33 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-8968544f-302a-4685-ac07-817df19b8389 req-3694a67c-beb4-446b-93c3-e550b6f4efa8 tempest-VolumesGetTestJSON-46276260 None] Created volume successfully.
Sep 10 13:59:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Acquiring lock "cinder-60fa5016-759d-4c01-8dce-b244abc84774-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Lock "cinder-60fa5016-759d-4c01-8dce-b244abc84774-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:33 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Acquiring lock "cinder-quobyte-60fa5016-759d-4c01-8dce-b244abc84774" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Lock "cinder-quobyte-60fa5016-759d-4c01-8dce-b244abc84774" acquired by "delete_volume" :: waited 0.018s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:33 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca2437c-e8b4-48bb-9f0b-c09df567fde4]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-60fa5016-759d-4c01-8dce-b244abc84774 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-60fa5016-759d-4c01-8dce-b244abc84774" returned: 0 in 0.561s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-60fa5016-759d-4c01-8dce-b244abc84774 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-60fa5016-759d-4c01-8dce-b244abc84774" returned: 0 in 0.268s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Lock "cinder-quobyte-60fa5016-759d-4c01-8dce-b244abc84774" released by "delete_volume" :: held 1.037s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:35 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=87,cinder:SELECT=74,cinder:DELETE=7,cinder:INSERT=18 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:59:35 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=78,cinder:SELECT=72,cinder:INSERT=23,cinder:DELETE=6 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 13:59:35 devstack cinder-volume[82823]: DEBUG cinder.quota [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Created reservations ['5d7c183d-6ed5-4d30-b92e-65b8dfbe6581', 'ca4bc542-b9f1-47b7-8be6-7ff0eb8186fd', 'c64cadb3-df05-4686-90f2-28ea36ed1373', '428d7d7e-6334-41aa-b9f6-e78b79f53052'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:59:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:35 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:59:35 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:59:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.137s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:35 devstack cinder-volume[82823]: DEBUG cinder.manager [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:59:35 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Deleted volume successfully.
Sep 10 13:59:35 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-eb737a8a-bf3f-4064-ac17-c0f0684568c6 req-2bd2f547-1385-4231-aee7-a57e650f7412 tempest-VolumesGetTestJSON-46276260 None] Lock "cinder-60fa5016-759d-4c01-8dce-b244abc84774-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:43 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-45a847d8-29df-43ed-bd98-b76552f67fe6 tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:43 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-45a847d8-29df-43ed-bd98-b76552f67fe6 tempest-GroupSnapshotsTest-1249817286 None] Group tempest-GroupSnapshotsTest-Group-963951390: creating
Sep 10 13:59:43 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-45a847d8-29df-43ed-bd98-b76552f67fe6 tempest-GroupSnapshotsTest-1249817286 None] Group tempest-GroupSnapshotsTest-Group-963951390: created successfully
Sep 10 13:59:43 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-45a847d8-29df-43ed-bd98-b76552f67fe6 tempest-GroupSnapshotsTest-1249817286 None] Create group completed successfully.
Sep 10 13:59:45 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Flow 'volume_create_manager' (a37d7b69-bcb0-4dcb-a104-4d3dc09383bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31745f4-d899-4cbf-8e95-a46001392b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31745f4-d899-4cbf-8e95-a46001392b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1884015055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=59686dd2-6bb8-408f-8c36-ebe256f98b01,host='devstack@QuobyteHD#QuobyteHD',id=5abc01e3-7b44-4144-9967-3a4ad84f916c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306c34f9f28e4237a8326f130376bbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:45Z,use_quota=True,user_id='017ad814bbb14e62895a37ebd509dd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea91e5a4-8fbb-422c-9361-a36c75ade341),volume_type_id=ea91e5a4-8fbb-422c-9361-a36c75ade341)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9419ff4-e7de-4fc5-b133-aa2e8915de4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9419ff4-e7de-4fc5-b133-aa2e8915de4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75161ec9-6789-41cb-a758-5235dae724cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75161ec9-6789-41cb-a758-5235dae724cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5abc01e3-7b44-4144-9967-3a4ad84f916c', 'volume_name': 'volume-5abc01e3-7b44-4144-9967-3a4ad84f916c', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e2ce2b-3563-4700-9549-5dbb4803f034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e2ce2b-3563-4700-9549-5dbb4803f034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7e9c5f-77a8-44c2-b638-12de2c83b479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:45 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Volume 5abc01e3-7b44-4144-9967-3a4ad84f916c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5abc01e3-7b44-4144-9967-3a4ad84f916c', 'volume_size': 1}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=59686dd2-6bb8-408f-8c36-ebe256f98b01,created_at=2025-09-10T11:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1884015055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=59686dd2-6bb8-408f-8c36-ebe256f98b01,host='devstack@QuobyteHD#QuobyteHD',id=5abc01e3-7b44-4144-9967-3a4ad84f916c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306c34f9f28e4237a8326f130376bbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:45Z,use_quota=True,user_id='017ad814bbb14e62895a37ebd509dd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea91e5a4-8fbb-422c-9361-a36c75ade341),volume_type_id=ea91e5a4-8fbb-422c-9361-a36c75ade341)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Creating volume 5abc01e3-7b44-4144-9967-3a4ad84f916c {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:59:45 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:45 devstack quobyte-client[82845]: System call of process 95652 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:59:45 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=66, name=volume-5abc01e3-7b44-4144-9967-3a4ad84f916c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c 1073741824" returned: 0 in 0.453s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c" returned: 0 in 0.150s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] <== create_volume: return (676ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:59:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:46 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7e9c5f-77a8-44c2-b638-12de2c83b479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5abc01e3-7b44-4144-9967-3a4ad84f916c', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:46 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708499cb-7c3b-42ef-bc3b-9d91032317db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:46 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Volume volume-5abc01e3-7b44-4144-9967-3a4ad84f916c (5abc01e3-7b44-4144-9967-3a4ad84f916c): created successfully
Sep 10 13:59:46 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708499cb-7c3b-42ef-bc3b-9d91032317db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:46 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Flow 'volume_create_manager' (a37d7b69-bcb0-4dcb-a104-4d3dc09383bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:59:46 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-12636d6e-a6be-4a77-b777-47ff0c02bb0b tempest-GroupSnapshotsTest-1249817286 None] Created volume successfully.
Sep 10 13:59:47 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] GroupSnapshot e9f0b630-dfa6-4d46-8bc2-5916e9d82b38: creating.
Sep 10 13:59:47 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] Group snapshot e9f0b630-dfa6-4d46-8bc2-5916e9d82b38: creating. {{(pid=82823) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 13:59:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] Creating offline snapshot e6792c8b-75d7-4190-b998-4555c5e3dade of volume 5abc01e3-7b44-4144-9967-3a4ad84f916c {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 13:59:47 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[207a6c62-cf64-4a4f-8abb-15b0b16f2ea4]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c" returned: 0 in 0.566s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:48 devstack quobyte-client[82845]: System call of process 95659 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:59:48 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=67, name=volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:59:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade 1G" returned: 0 in 0.420s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5abc01e3-7b44-4144-9967-3a4ad84f916c -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:49 devstack quobyte-client[82845]: System call of process 95662 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:59:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img rebase -u -b volume-5abc01e3-7b44-4144-9967-3a4ad84f916c -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade" returned: 0 in 0.183s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:49 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:59:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade" returned: 0 in 0.110s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:49 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 13:59:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade" returned: 0 in 0.132s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.info" returned: 0 in 0.149s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:49 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 13:59:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.info" returned: 0 in 0.096s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.157s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:50 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Flow 'volume_create_manager' (556f3fd0-9983-4d41-abf2-33d1a7d48ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edd8d91-8d18-4594-8bf0-2024c9e52be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:50 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Flow 'volume_create_manager' (c58be813-8895-42cf-b4e7-0a371e50586f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c1ea9b-2501-45d2-8c3f-80e987f84b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edd8d91-8d18-4594-8bf0-2024c9e52be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1989096999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51beecf7-4e94-4d6d-b3fa-01cbae96285f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fa85a7327c4334a4f6cc4ff63dd858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:50Z,use_quota=True,user_id='69c1d95cb5104240b4ee8d1e11c857db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c579fb68-3a8e-466a-952e-3e4244f69086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c579fb68-3a8e-466a-952e-3e4244f69086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3f5abd-2e0d-42ae-9157-a5a8bcb6c9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3f5abd-2e0d-42ae-9157-a5a8bcb6c9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51beecf7-4e94-4d6d-b3fa-01cbae96285f', 'volume_name': 'volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150452bf-e774-4324-8aa4-1e773c807ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150452bf-e774-4324-8aa4-1e773c807ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f185f1-cf10-4e0b-a001-f1a66e6984ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:50 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume 51beecf7-4e94-4d6d-b3fa-01cbae96285f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f', 'volume_size': 1}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1989096999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51beecf7-4e94-4d6d-b3fa-01cbae96285f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fa85a7327c4334a4f6cc4ff63dd858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:50Z,use_quota=True,user_id='69c1d95cb5104240b4ee8d1e11c857db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Creating volume 51beecf7-4e94-4d6d-b3fa-01cbae96285f {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:59:50 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:59:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:50 devstack quobyte-client[82845]: System call of process 95670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 13:59:50 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=69, name=volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:59:50 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-0f4225ec-73ad-4984-a190-895640ca79d6 tempest-GroupSnapshotsTest-1249817286 None] group_snapshot e9f0b630-dfa6-4d46-8bc2-5916e9d82b38: created successfully
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c1ea9b-2501-45d2-8c3f-80e987f84b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2123489488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b915a1a-e346-416d-a4bd-a4f14be3d5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4290e303564716b21b5762253b8b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:50Z,use_quota=True,user_id='e4631d003c624d479b7e42074e22e970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ca8eb1-7da4-4e41-aaaf-bab2a359c5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ca8eb1-7da4-4e41-aaaf-bab2a359c5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc2fc4e-7baa-4d27-be3f-5b57a3de7b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc2fc4e-7baa-4d27-be3f-5b57a3de7b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b915a1a-e346-416d-a4bd-a4f14be3d5bd', 'volume_name': 'volume-2b915a1a-e346-416d-a4bd-a4f14be3d5bd', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfce282-6070-4c19-9c0b-a4513fd573ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfce282-6070-4c19-9c0b-a4513fd573ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7624a962-bd28-4b65-acf7-0c374b0ff851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:51 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Volume 2b915a1a-e346-416d-a4bd-a4f14be3d5bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b915a1a-e346-416d-a4bd-a4f14be3d5bd', 'volume_size': 1}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f 1073741824" returned: 0 in 0.523s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f" returned: 0 in 0.118s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] <== create_volume: return (687ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2123489488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b915a1a-e346-416d-a4bd-a4f14be3d5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4290e303564716b21b5762253b8b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:50Z,use_quota=True,user_id='e4631d003c624d479b7e42074e22e970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Creating volume 2b915a1a-e346-416d-a4bd-a4f14be3d5bd {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:59:51 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2b915a1a-e346-416d-a4bd-a4f14be3d5bd 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:51 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=70, name=volume-2b915a1a-e346-416d-a4bd-a4f14be3d5bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f185f1-cf10-4e0b-a001-f1a66e6984ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8970f1d2-c50b-4d86-89fd-572f3ea70380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2b915a1a-e346-416d-a4bd-a4f14be3d5bd 1073741824" returned: 0 in 0.436s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2b915a1a-e346-416d-a4bd-a4f14be3d5bd {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:52 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f (51beecf7-4e94-4d6d-b3fa-01cbae96285f): created successfully
Sep 10 13:59:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8970f1d2-c50b-4d86-89fd-572f3ea70380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Flow 'volume_create_manager' (556f3fd0-9983-4d41-abf2-33d1a7d48ba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:59:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2b915a1a-e346-416d-a4bd-a4f14be3d5bd" returned: 0 in 0.329s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] <== create_volume: return (788ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 13:59:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:52 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-bfb35ff4-ca77-4834-8735-636585d56ba3 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Created volume successfully.
Sep 10 13:59:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7624a962-bd28-4b65-acf7-0c374b0ff851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b915a1a-e346-416d-a4bd-a4f14be3d5bd', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb92099-f006-472f-8e3d-1e1c5bd0fe2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:52 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Volume volume-2b915a1a-e346-416d-a4bd-a4f14be3d5bd (2b915a1a-e346-416d-a4bd-a4f14be3d5bd): created successfully
Sep 10 13:59:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb92099-f006-472f-8e3d-1e1c5bd0fe2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Flow 'volume_create_manager' (c58be813-8895-42cf-b4e7-0a371e50586f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:59:52 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-3be756e0-dda7-4d07-89c6-98c6bda0b322 tempest-VolumeQuotasAdminTestJSON-976898268 None] Created volume successfully.
Sep 10 13:59:53 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "cinder-quobyte-e6792c8b-75d7-4190-b998-4555c5e3dade-169a3804-4f58-4fda-8f8a-9d182a11cf42" by "_create_volume_from_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Acquiring lock "cinder-2b915a1a-e346-416d-a4bd-a4f14be3d5bd-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:53 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-e6792c8b-75d7-4190-b998-4555c5e3dade-169a3804-4f58-4fda-8f8a-9d182a11cf42" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Creating volume 169a3804-4f58-4fda-8f8a-9d182a11cf42 from snapshot e6792c8b-75d7-4190-b998-4555c5e3dade {{(pid=82823) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "cinder-quobyte-169a3804-4f58-4fda-8f8a-9d182a11cf42" by "_copy_volume_from_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Lock "cinder-2b915a1a-e346-416d-a4bd-a4f14be3d5bd-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-169a3804-4f58-4fda-8f8a-9d182a11cf42" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] snapshot: e6792c8b-75d7-4190-b998-4555c5e3dade, volume: 169a3804-4f58-4fda-8f8a-9d182a11cf42,  {{(pid=82823) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac84a79-8b7e-4233-b043-d32e0466c634]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:53 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Acquiring lock "cinder-quobyte-2b915a1a-e346-416d-a4bd-a4f14be3d5bd" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Lock "cinder-quobyte-2b915a1a-e346-416d-a4bd-a4f14be3d5bd" acquired by "delete_volume" :: waited 0.069s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3fa9dd-c776-40ed-814b-7143cd9dae8b]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2b915a1a-e346-416d-a4bd-a4f14be3d5bd {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade" returned: 0 in 0.574s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5abc01e3-7b44-4144-9967-3a4ad84f916c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c {{(pid=82823) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 13:59:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Creating direct copy from snapshot {{(pid=82823) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 13:59:54 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcacfac-a0ad-4e33-b5cc-3c35d88a9b50]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 13:59:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2b915a1a-e346-416d-a4bd-a4f14be3d5bd" returned: 0 in 0.523s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2b915a1a-e346-416d-a4bd-a4f14be3d5bd {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2b915a1a-e346-416d-a4bd-a4f14be3d5bd" returned: 0 in 0.101s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Lock "cinder-quobyte-2b915a1a-e346-416d-a4bd-a4f14be3d5bd" released by "delete_volume" :: held 0.826s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c" returned: 0 in 0.741s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:54 devstack cinder-volume[82823]: DEBUG cinder.utils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169a3804-4f58-4fda-8f8a-9d182a11cf42 not found in is_blk_device check {{(pid=82823) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 13:59:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169a3804-4f58-4fda-8f8a-9d182a11cf42 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:54 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=71, name=volume-169a3804-4f58-4fda-8f8a-9d182a11cf42, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 13:59:55 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Created reservations ['9320d7f9-6122-401a-8593-6118d29bdc0e', '2a526009-bb6d-4b41-8366-c71b6e732270', 'ad840b4e-059b-403a-ba90-e1ad54f8b252', '3bdab3a0-9abf-4193-a769-c7ef53345b4c'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 13:59:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 13:59:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 13:59:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 13:59:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 13:59:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 13:59:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 13:59:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.510s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 13:59:56 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 13:59:56 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Deleted volume successfully.
Sep 10 13:59:58 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-403cd355-93f4-40a8-8c50-794f2f303e99 tempest-VolumeQuotasAdminTestJSON-976898268 None] Lock "cinder-2b915a1a-e346-416d-a4bd-a4f14be3d5bd-delete_volume" released by "delete_volume" :: held 4.935s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 13:59:58 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 13:59:58 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 13:59:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Flow 'volume_create_manager' (1dff1019-7735-4490-b99e-882ebec487d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 13:59:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f7e682-af00-45e4-8bc2-847c7378ac54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f7e682-af00-45e4-8bc2-847c7378ac54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-32015454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8664ce0-ecc6-416c-a290-83194d63de5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4290e303564716b21b5762253b8b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:58Z,use_quota=True,user_id='e4631d003c624d479b7e42074e22e970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1d4d8d-1cc8-4885-9891-4898a93a6306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1d4d8d-1cc8-4885-9891-4898a93a6306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edcd3b3c-c391-4c8f-b2df-bf4a05031c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edcd3b3c-c391-4c8f-b2df-bf4a05031c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8664ce0-ecc6-416c-a290-83194d63de5f', 'volume_name': 'volume-c8664ce0-ecc6-416c-a290-83194d63de5f', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fcf8806-eb5f-4acb-ae35-319ae7097c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fcf8806-eb5f-4acb-ae35-319ae7097c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 13:59:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a48d8f-3747-47f2-bf1b-a6ea48f4b471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 13:59:58 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Volume c8664ce0-ecc6-416c-a290-83194d63de5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8664ce0-ecc6-416c-a290-83194d63de5f', 'volume_size': 1}
Sep 10 13:59:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169a3804-4f58-4fda-8f8a-9d182a11cf42" returned: 0 in 7.485s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:02 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18af19b-62d3-4100-ae3a-b8be8ad4c483]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c" returned: 0 in 0.526s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:02 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169a3804-4f58-4fda-8f8a-9d182a11cf42 {{(pid=82823) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 14:00:02 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Converted 1024.00 MB image at 136.76 MB/s
Sep 10 14:00:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169a3804-4f58-4fda-8f8a-9d182a11cf42 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:00:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169a3804-4f58-4fda-8f8a-9d182a11cf42 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169a3804-4f58-4fda-8f8a-9d182a11cf42" returned: 0 in 0.157s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-169a3804-4f58-4fda-8f8a-9d182a11cf42" released by "_copy_volume_from_snapshot" :: held 9.819s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-e6792c8b-75d7-4190-b998-4555c5e3dade-169a3804-4f58-4fda-8f8a-9d182a11cf42" released by "_create_volume_from_snapshot" :: held 9.891s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.973s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.034s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Creating offline snapshot 108264a8-01e2-458a-b9a9-1060b5aa6a2e of volume 51beecf7-4e94-4d6d-b3fa-01cbae96285f {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:00:03 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54fda1b-78f9-40f8-98f7-f8ffc42f2664]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:03 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-46cecb5c-3c60-430c-a4e0-8627407d9e9c tempest-GroupSnapshotsTest-1249817286 None] Create group from source-snapshot-e9f0b630-dfa6-4d46-8bc2-5916e9d82b38 completed successfully.
Sep 10 14:00:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f" returned: 0 in 0.570s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:04 devstack quobyte-client[82845]: System call of process 95711 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:00:04 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=72, name=volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:00:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e 1G" returned: 0 in 0.263s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): qemu-img rebase -u -b volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "qemu-img rebase -u -b volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e" returned: 0 in 0.143s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:04 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:00:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e" returned: 0 in 0.095s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:04 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:00:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e" returned: 0 in 0.388s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:05 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.info" returned: 0 in 0.334s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "cinder-quobyte-169a3804-4f58-4fda-8f8a-9d182a11cf42" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.info" returned: 0 in 0.210s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.626s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T11:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-32015454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8664ce0-ecc6-416c-a290-83194d63de5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4290e303564716b21b5762253b8b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T11:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T11:59:58Z,use_quota=True,user_id='e4631d003c624d479b7e42074e22e970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Creating volume c8664ce0-ecc6-416c-a290-83194d63de5f {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:00:05 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c8664ce0-ecc6-416c-a290-83194d63de5f 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:05 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=74, name=volume-c8664ce0-ecc6-416c-a290-83194d63de5f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:00:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-169a3804-4f58-4fda-8f8a-9d182a11cf42" acquired by "delete_volume" :: waited 0.487s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:06 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8c7b59-f8ca-4169-8254-21bdf95bf205]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169a3804-4f58-4fda-8f8a-9d182a11cf42 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:06 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-d50d5458-f6d5-4484-ad0d-a13d364e5a01 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Create snapshot completed successfully
Sep 10 14:00:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c8664ce0-ecc6-416c-a290-83194d63de5f 1073741824" returned: 0 in 0.775s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c8664ce0-ecc6-416c-a290-83194d63de5f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c8664ce0-ecc6-416c-a290-83194d63de5f" returned: 0 in 0.156s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] <== create_volume: return (991ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:00:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169a3804-4f58-4fda-8f8a-9d182a11cf42" returned: 0 in 0.664s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169a3804-4f58-4fda-8f8a-9d182a11cf42 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a48d8f-3747-47f2-bf1b-a6ea48f4b471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8664ce0-ecc6-416c-a290-83194d63de5f', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47b1133-75fa-49c8-8b7a-e9e51e19e93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169a3804-4f58-4fda-8f8a-9d182a11cf42" returned: 0 in 0.329s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-169a3804-4f58-4fda-8f8a-9d182a11cf42" released by "delete_volume" :: held 1.210s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:07 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Volume volume-c8664ce0-ecc6-416c-a290-83194d63de5f (c8664ce0-ecc6-416c-a290-83194d63de5f): created successfully
Sep 10 14:00:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47b1133-75fa-49c8-8b7a-e9e51e19e93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Flow 'volume_create_manager' (1dff1019-7735-4490-b99e-882ebec487d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:07 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-2eee9875-3a28-4a28-9300-34c0cbc5ebbd tempest-VolumeQuotasAdminTestJSON-976898268 None] Created volume successfully.
Sep 10 14:00:07 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Created reservations ['5318bf6b-cbc9-4a59-a59a-aa8c0b3968bf'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:07 devstack cinder-volume[82823]: WARNING cinder.quota [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-587783604 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-587783604, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:00:07 devstack cinder-volume[82823]: WARNING cinder.quota [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-587783604 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-587783604, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:00:07 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Created reservations ['a4b6ad32-1ab5-4170-b177-c9cebb57cd5e', '74bff297-9f7a-4a79-99e0-04beaa7b0a58', 'bc64dab5-042a-4b01-975e-1cf3aa4a2ba1', '58d84afa-f354-4907-9061-d3a89281e175'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.440s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:00:08 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Flow 'volume_create_manager' (e2cf27be-e6c0-4f65-ac7a-035d9973619d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436b3968-8a35-41e3-a925-0f513178f7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:08 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-dd509f42-c48d-4609-86f9-14daf5ffc19b tempest-GroupSnapshotsTest-1249817286 None] Delete group completed successfully.
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436b3968-8a35-41e3-a925-0f513178f7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1882337186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72050bd1-5dbf-439f-950e-2ad776849e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fa85a7327c4334a4f6cc4ff63dd858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:08Z,use_quota=True,user_id='69c1d95cb5104240b4ee8d1e11c857db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd35ce0-a1f8-4989-bcae-08f7b5a7bb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd35ce0-a1f8-4989-bcae-08f7b5a7bb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bb46b6-3326-4ada-aa7f-1ebebb207e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bb46b6-3326-4ada-aa7f-1ebebb207e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72050bd1-5dbf-439f-950e-2ad776849e27', 'volume_name': 'volume-72050bd1-5dbf-439f-950e-2ad776849e27', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ffceba-9e03-48c6-a44d-7e27dd6b3470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ffceba-9e03-48c6-a44d-7e27dd6b3470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d84e8a-51bd-41a9-bc02-ae69fc56cc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:08 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume 72050bd1-5dbf-439f-950e-2ad776849e27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72050bd1-5dbf-439f-950e-2ad776849e27', 'volume_size': 1}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1882337186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72050bd1-5dbf-439f-950e-2ad776849e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fa85a7327c4334a4f6cc4ff63dd858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:08Z,use_quota=True,user_id='69c1d95cb5104240b4ee8d1e11c857db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Creating volume 72050bd1-5dbf-439f-950e-2ad776849e27 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:00:08 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:00:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-72050bd1-5dbf-439f-950e-2ad776849e27 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:08 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=75, name=volume-72050bd1-5dbf-439f-950e-2ad776849e27, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:00:09 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a0a1d4e4-2d3b-4e23-8afe-9325ed47dec8 tempest-VolumeQuotasAdminTestJSON-181643983 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:09 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a0a1d4e4-2d3b-4e23-8afe-9325ed47dec8 tempest-VolumeQuotasAdminTestJSON-181643983 None] Transfer volume completed successfully.
Sep 10 14:00:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-72050bd1-5dbf-439f-950e-2ad776849e27 1073741824" returned: 0 in 0.663s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-72050bd1-5dbf-439f-950e-2ad776849e27 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:09 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:09 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:00:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Flow 'volume_create_manager' (30c279cf-e0ef-476f-b63c-b98f0d2859c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f358ea10-83e9-4413-8d2a-195b325fde17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:10 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] group_snapshot e9f0b630-dfa6-4d46-8bc2-5916e9d82b38: deleting
Sep 10 14:00:10 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Flow 'volume_create_manager' (96868f8c-58a9-46d4-a16a-5227a30a7c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc6f407-6f5b-489f-a531-df55a3a69305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc6f407-6f5b-489f-a531-df55a3a69305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1217751066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be05f9d-905e-4ea0-940c-381856b00b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fa85a7327c4334a4f6cc4ff63dd858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:09Z,use_quota=True,user_id='69c1d95cb5104240b4ee8d1e11c857db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4b4986-ebda-40e3-b446-b60b710d1389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4b4986-ebda-40e3-b446-b60b710d1389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4429c27c-f937-4701-8074-5e2f6f0bb9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4429c27c-f937-4701-8074-5e2f6f0bb9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0be05f9d-905e-4ea0-940c-381856b00b6b', 'volume_name': 'volume-0be05f9d-905e-4ea0-940c-381856b00b6b', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5885e5-a8e2-4dba-8af6-b37ea4a9558d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5885e5-a8e2-4dba-8af6-b37ea4a9558d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b52140-ab1a-4087-9cbd-f811e8e78386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:10 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume 0be05f9d-905e-4ea0-940c-381856b00b6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0be05f9d-905e-4ea0-940c-381856b00b6b', 'volume_size': 1}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-72050bd1-5dbf-439f-950e-2ad776849e27" returned: 0 in 1.330s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] <== create_volume: return (2011ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f358ea10-83e9-4413-8d2a-195b325fde17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-797719127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258f94cb-e1f6-40ab-b04f-f4bdedcef3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fa85a7327c4334a4f6cc4ff63dd858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:09Z,use_quota=True,user_id='69c1d95cb5104240b4ee8d1e11c857db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e93a111-35d7-4fd5-8c76-8657f8a888c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e93a111-35d7-4fd5-8c76-8657f8a888c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e9c15a-55ff-4c83-b276-5862e67c21e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e9c15a-55ff-4c83-b276-5862e67c21e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '258f94cb-e1f6-40ab-b04f-f4bdedcef3dd', 'volume_name': 'volume-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8133330-04e7-40c3-80c1-01c58982627d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8133330-04e7-40c3-80c1-01c58982627d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b6518c-0197-432f-87f0-7504f54febc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:10 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume 258f94cb-e1f6-40ab-b04f-f4bdedcef3dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd', 'volume_size': 1}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-797719127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258f94cb-e1f6-40ab-b04f-f4bdedcef3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fa85a7327c4334a4f6cc4ff63dd858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:09Z,use_quota=True,user_id='69c1d95cb5104240b4ee8d1e11c857db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Creating volume 258f94cb-e1f6-40ab-b04f-f4bdedcef3dd {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:00:10 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:00:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:10 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=76, name=volume-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:00:11 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Acquiring lock "cinder-c8664ce0-ecc6-416c-a290-83194d63de5f-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d84e8a-51bd-41a9-bc02-ae69fc56cc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72050bd1-5dbf-439f-950e-2ad776849e27', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd77b63b-b360-43eb-9ed2-64498d85896b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd 1073741824" returned: 0 in 0.856s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:11 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume volume-72050bd1-5dbf-439f-950e-2ad776849e27 (72050bd1-5dbf-439f-950e-2ad776849e27): created successfully
Sep 10 14:00:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd77b63b-b360-43eb-9ed2-64498d85896b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Flow 'volume_create_manager' (e2cf27be-e6c0-4f65-ac7a-035d9973619d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Lock "cinder-c8664ce0-ecc6-416c-a290-83194d63de5f-delete_volume" acquired by "delete_volume" :: waited 0.693s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:12 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Flow 'volume_create_manager' (86b508c9-1775-4fe6-b41b-7ae4de42b6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c56140cc-4486-441b-9843-7be79a4f78e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:12 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f7ff2cc7-6d95-4e91-958b-820c97eb93d7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Created volume successfully.
Sep 10 14:00:12 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] group_snapshot e9f0b630-dfa6-4d46-8bc2-5916e9d82b38: deleting {{(pid=82823) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 14:00:12 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Flow 'volume_create_manager' (5ea780b6-53ab-46d8-8e69-1ceef9d0ff2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf0670d-1e4f-44dd-9722-3f09d8b76eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd" returned: 0 in 0.684s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf0670d-1e4f-44dd-9722-3f09d8b76eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1976161631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fa85a7327c4334a4f6cc4ff63dd858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:11Z,use_quota=True,user_id='69c1d95cb5104240b4ee8d1e11c857db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf93511-f641-41fd-a0c8-bc73801e7270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf93511-f641-41fd-a0c8-bc73801e7270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc378f9-51ba-44fd-9691-72efa5309856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc378f9-51ba-44fd-9691-72efa5309856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d', 'volume_name': 'volume-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebbc312-8a83-4be8-8213-e50c5f63f101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebbc312-8a83-4be8-8213-e50c5f63f101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4473dac3-67bc-4a55-9d58-5a5a840dfc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:12 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume 2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d', 'volume_size': 1}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c56140cc-4486-441b-9843-7be79a4f78e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1928014207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52f32ef-9482-4c11-8e1e-c92e296024ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fa85a7327c4334a4f6cc4ff63dd858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:10Z,use_quota=True,user_id='69c1d95cb5104240b4ee8d1e11c857db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462e4d15-7f3d-416f-a10a-824d58c3fa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462e4d15-7f3d-416f-a10a-824d58c3fa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b1638f-ea4e-4f69-ae73-a3997af5228e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b1638f-ea4e-4f69-ae73-a3997af5228e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e52f32ef-9482-4c11-8e1e-c92e296024ec', 'volume_name': 'volume-e52f32ef-9482-4c11-8e1e-c92e296024ec', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6ee558-91b6-43d9-8f4a-e1676de62024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6ee558-91b6-43d9-8f4a-e1676de62024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b661c2-d003-4da3-bcc1-a27e1c063e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:12 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume e52f32ef-9482-4c11-8e1e-c92e296024ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e52f32ef-9482-4c11-8e1e-c92e296024ec', 'volume_size': 1}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] <== create_volume: return (1644ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.744s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1217751066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be05f9d-905e-4ea0-940c-381856b00b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fa85a7327c4334a4f6cc4ff63dd858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:09Z,use_quota=True,user_id='69c1d95cb5104240b4ee8d1e11c857db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Creating volume 0be05f9d-905e-4ea0-940c-381856b00b6b {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:00:12 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0be05f9d-905e-4ea0-940c-381856b00b6b 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:12 devstack quobyte-client[82845]: System call of process 95774 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:00:12 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=77, name=volume-0be05f9d-905e-4ea0-940c-381856b00b6b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b6518c-0197-432f-87f0-7504f54febc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7fef08f-3d65-4da5-ae8d-d413ab2be735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "cinder-quobyte-5abc01e3-7b44-4144-9967-3a4ad84f916c" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:12 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume volume-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd (258f94cb-e1f6-40ab-b04f-f4bdedcef3dd): created successfully
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7fef08f-3d65-4da5-ae8d-d413ab2be735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Flow 'volume_create_manager' (30c279cf-e0ef-476f-b63c-b98f0d2859c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0be05f9d-905e-4ea0-940c-381856b00b6b 1073741824" returned: 0 in 0.629s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0be05f9d-905e-4ea0-940c-381856b00b6b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-5abc01e3-7b44-4144-9967-3a4ad84f916c" acquired by "delete_snapshot" :: waited 0.378s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "cinder-quobyte-e6792c8b-75d7-4190-b998-4555c5e3dade" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:13 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-05808335-8312-4483-b7a7-3da680d4ba87 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Created volume successfully.
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0be05f9d-905e-4ea0-940c-381856b00b6b" returned: 0 in 0.458s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] <== create_volume: return (1107ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.187s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1976161631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fa85a7327c4334a4f6cc4ff63dd858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:11Z,use_quota=True,user_id='69c1d95cb5104240b4ee8d1e11c857db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Creating volume 2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:00:13 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:13 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:13 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=78, name=volume-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Acquiring lock "cinder-quobyte-c8664ce0-ecc6-416c-a290-83194d63de5f" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-e6792c8b-75d7-4190-b998-4555c5e3dade" acquired by "_delete_snapshot" :: waited 0.488s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] Deleting offline snapshot e6792c8b-75d7-4190-b998-4555c5e3dade of volume 5abc01e3-7b44-4144-9967-3a4ad84f916c {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] snapshot_file for this snap is: volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb9f66f-fedb-4b5b-acb0-1bdcb706b5c4]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b52140-ab1a-4087-9cbd-f811e8e78386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0be05f9d-905e-4ea0-940c-381856b00b6b', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8412a620-568d-4801-a087-aad4291de154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d 1073741824" returned: 0 in 0.846s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Lock "cinder-quobyte-c8664ce0-ecc6-416c-a290-83194d63de5f" acquired by "delete_volume" :: waited 0.856s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:14 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdb12ef-c9ab-4bd0-a78a-67982d18894a]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c8664ce0-ecc6-416c-a290-83194d63de5f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:14 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume volume-0be05f9d-905e-4ea0-940c-381856b00b6b (0be05f9d-905e-4ea0-940c-381856b00b6b): created successfully
Sep 10 14:00:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8412a620-568d-4801-a087-aad4291de154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Flow 'volume_create_manager' (96868f8c-58a9-46d4-a16a-5227a30a7c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d" returned: 0 in 0.716s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] <== create_volume: return (1587ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade" returned: 0 in 1.217s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.776s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1928014207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52f32ef-9482-4c11-8e1e-c92e296024ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fa85a7327c4334a4f6cc4ff63dd858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:10Z,use_quota=True,user_id='69c1d95cb5104240b4ee8d1e11c857db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Creating volume e52f32ef-9482-4c11-8e1e-c92e296024ec {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:00:15 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e52f32ef-9482-4c11-8e1e-c92e296024ec 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5abc01e3-7b44-4144-9967-3a4ad84f916c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:00:15 devstack quobyte-client[82845]: System call of process 95786 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:00:15 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=79, name=volume-e52f32ef-9482-4c11-8e1e-c92e296024ec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:00:15 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-58f730c3-c4eb-476f-9d65-fcd60d44450f tempest-CreateVolumesFromSnapshotTest-1077906913 None] Created volume successfully.
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe34fe5a-7a72-417c-97c8-a307c6113219]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4473dac3-67bc-4a55-9d58-5a5a840dfc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114bc6ff-0829-4a89-b894-78b90beb5e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c8664ce0-ecc6-416c-a290-83194d63de5f" returned: 0 in 1.344s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c8664ce0-ecc6-416c-a290-83194d63de5f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:16 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume volume-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d (2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d): created successfully
Sep 10 14:00:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114bc6ff-0829-4a89-b894-78b90beb5e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Flow 'volume_create_manager' (5ea780b6-53ab-46d8-8e69-1ceef9d0ff2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e52f32ef-9482-4c11-8e1e-c92e296024ec 1073741824" returned: 0 in 1.310s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e52f32ef-9482-4c11-8e1e-c92e296024ec {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c8664ce0-ecc6-416c-a290-83194d63de5f" returned: 0 in 0.700s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:16 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-d257a746-b7d6-4bd2-bb3d-2a4d158acb91 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Created volume successfully.
Sep 10 14:00:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c" returned: 0 in 1.291s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e52f32ef-9482-4c11-8e1e-c92e296024ec" returned: 0 in 0.451s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:17 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] <== create_volume: return (2057ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:00:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Lock "cinder-quobyte-c8664ce0-ecc6-416c-a290-83194d63de5f" released by "delete_volume" :: held 2.762s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b661c2-d003-4da3-bcc1-a27e1c063e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e52f32ef-9482-4c11-8e1e-c92e296024ec', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b51286-a2ab-46ee-92a2-16b8f0e7a5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade" returned: 0 in 0.554s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:17 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume volume-e52f32ef-9482-4c11-8e1e-c92e296024ec (e52f32ef-9482-4c11-8e1e-c92e296024ec): created successfully
Sep 10 14:00:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b51286-a2ab-46ee-92a2-16b8f0e7a5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Flow 'volume_create_manager' (86b508c9-1775-4fe6-b41b-7ae4de42b6cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "cinder-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c.e6792c8b-75d7-4190-b998-4555c5e3dade" returned: 0 in 0.601s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:18 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-9ee0fea0-c3cd-4a5d-a42d-f6191bd8c3ad tempest-CreateVolumesFromSnapshotTest-1077906913 None] Created volume successfully.
Sep 10 14:00:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-e6792c8b-75d7-4190-b998-4555c5e3dade" released by "_delete_snapshot" :: held 4.356s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-5abc01e3-7b44-4144-9967-3a4ad84f916c" released by "delete_snapshot" :: held 4.904s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:18 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Created reservations ['1daca1bd-e82f-4cab-ab6b-5e36f5f7bd4d', '4fcf208d-0a35-4742-8c9b-deecb2bb91e4', '3bf7422b-85d1-4b93-a096-726d59a27865', '4b63a019-7758-4d5e-94f9-b18ffea1ba2f'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:18 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "cinder-quobyte-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d" acquired by "delete_volume" :: waited 0.039s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:18 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91306ee-cf9d-4af2-803a-acf44908e908]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:18 devstack cinder-volume[82823]: WARNING cinder.quota [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-587783604 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-587783604, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:00:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:19 devstack quobyte-client[82845]: System call of process 95802 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:00:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d" returned: 0 in 0.981s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.616s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:19 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:00:19 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] Created reservations ['154a4b14-86f0-43a5-9ef2-a5ff9f70b330', '30bb8fcc-6f7a-4bb7-932c-57a06513f180', 'c09774da-de89-4273-a2c4-cb99d190f093', 'c3a37116-f3b1-49ba-9f87-572d91ecc6f0'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:19 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Deleted volume successfully.
Sep 10 14:00:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d" returned: 0 in 0.513s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d" released by "delete_volume" :: held 1.624s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dcbd5bc2-fe53-4fce-a98c-f15f164de610 tempest-VolumeQuotasAdminTestJSON-815259237 None] Lock "cinder-c8664ce0-ecc6-416c-a290-83194d63de5f-delete_volume" released by "delete_volume" :: held 8.053s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:20 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Created reservations ['c130d94c-e5ff-4c9b-be56-4ef74913944e', '222e688d-0ca3-4440-a554-514f240d96fd', 'a4c52f66-7921-4388-8866-67052a2b8629', '4fd10eba-3b2c-42aa-a039-8acba6aa7137'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:20 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-c3340778-4107-4ea3-b821-4725b4572bdb tempest-GroupSnapshotsTest-1249817286 None] group_snapshot e9f0b630-dfa6-4d46-8bc2-5916e9d82b38: deleted successfully
Sep 10 14:00:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.175s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:20 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:00:20 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Deleted volume successfully.
Sep 10 14:00:21 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ff24bf6c-3f5a-45a4-9f3a-37a21c1b0607 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-2cbdd9e5-c3a1-4483-a40d-e3a3b44d482d-delete_volume" released by "delete_volume" :: held 2.970s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:21 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "cinder-e52f32ef-9482-4c11-8e1e-c92e296024ec-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:21 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-e52f32ef-9482-4c11-8e1e-c92e296024ec-delete_volume" acquired by "delete_volume" :: waited 0.200s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:21 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:21 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "cinder-quobyte-5abc01e3-7b44-4144-9967-3a4ad84f916c" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:21 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:21 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "cinder-quobyte-e52f32ef-9482-4c11-8e1e-c92e296024ec" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:21 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-5abc01e3-7b44-4144-9967-3a4ad84f916c" acquired by "delete_volume" :: waited 0.050s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:22 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[c569e1c7-aab7-4b08-b95f-db3ddcd5efca]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-e52f32ef-9482-4c11-8e1e-c92e296024ec" acquired by "delete_volume" :: waited 0.183s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:22 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f715ca9-506c-4a71-8edc-b1fdee14f57b]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e52f32ef-9482-4c11-8e1e-c92e296024ec {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c" returned: 0 in 0.713s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-5abc01e3-7b44-4144-9967-3a4ad84f916c" returned: 0 in 0.181s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-5abc01e3-7b44-4144-9967-3a4ad84f916c" released by "delete_volume" :: held 1.146s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e52f32ef-9482-4c11-8e1e-c92e296024ec" returned: 0 in 1.121s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e52f32ef-9482-4c11-8e1e-c92e296024ec {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e52f32ef-9482-4c11-8e1e-c92e296024ec" returned: 0 in 0.375s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-e52f32ef-9482-4c11-8e1e-c92e296024ec" released by "delete_volume" :: held 1.805s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:24 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Created reservations ['2bdc5009-532d-4010-92dc-0f546210699e'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:24 devstack cinder-volume[82823]: WARNING cinder.db.sqlalchemy.api [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-587783604']
Sep 10 14:00:24 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Created reservations ['6fccd793-de45-4ce3-95ca-c73ceabb4507', '009d805b-956b-4203-8d58-d2265f959c26', 'ee201148-055f-414f-85d0-8055a73cbe75', 'b4c01471-610c-4723-9b27-644d3f51eeaa'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:24 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Created reservations ['a5335fd7-3037-46e2-8ca0-f090526d1c4b', 'eace20c5-c0c4-4f3f-8abc-bb0aa0cc1dbc', 'ed55c995-0e85-44ad-a4fa-877c9c9120b5', '307dbbfc-3b93-4b94-86c3-237c17ac7a77'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.343s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:24 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:00:24 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Deleted volume successfully.
Sep 10 14:00:24 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-dd4985b5-3ddc-43b0-8158-70e97df0c34a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-e52f32ef-9482-4c11-8e1e-c92e296024ec-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.115s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:25 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:00:25 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-dea31bfb-a067-434b-8dda-fbf292bf0098 tempest-GroupSnapshotsTest-1249817286 None] Delete group completed successfully.
Sep 10 14:00:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "cinder-0be05f9d-905e-4ea0-940c-381856b00b6b-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-0be05f9d-905e-4ea0-940c-381856b00b6b-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:26 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:26 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "cinder-quobyte-0be05f9d-905e-4ea0-940c-381856b00b6b" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:26 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-0be05f9d-905e-4ea0-940c-381856b00b6b" acquired by "delete_volume" :: waited 0.018s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:26 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[969bd1c5-0df6-4aec-b99d-b43f4e7e638a]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0be05f9d-905e-4ea0-940c-381856b00b6b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:26 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-1a4059eb-9a72-4084-bcfc-30cb231e0766 tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:26 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-1a4059eb-9a72-4084-bcfc-30cb231e0766 tempest-GroupSnapshotsTest-1249817286 None] Group tempest-GroupSnapshotsTest-Group-523970399: creating
Sep 10 14:00:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0be05f9d-905e-4ea0-940c-381856b00b6b" returned: 0 in 0.772s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0be05f9d-905e-4ea0-940c-381856b00b6b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0be05f9d-905e-4ea0-940c-381856b00b6b" returned: 0 in 0.279s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-0be05f9d-905e-4ea0-940c-381856b00b6b" released by "delete_volume" :: held 1.208s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:27 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-1a4059eb-9a72-4084-bcfc-30cb231e0766 tempest-GroupSnapshotsTest-1249817286 None] Group tempest-GroupSnapshotsTest-Group-523970399: created successfully
Sep 10 14:00:27 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-1a4059eb-9a72-4084-bcfc-30cb231e0766 tempest-GroupSnapshotsTest-1249817286 None] Create group completed successfully.
Sep 10 14:00:27 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Created reservations ['6e76a7fb-c8b0-4ba5-83b1-96e6d619465d', 'f953b1e8-4492-4d00-9441-395f773ab9f4', '378773a0-9105-455a-80c8-e2bf16fd9514', '4f9ce0ba-88fc-41b7-9475-3ec1c770bae3'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.139s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:27 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:00:28 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Deleted volume successfully.
Sep 10 14:00:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-577c1975-dd04-4778-8d9a-847f395682b7 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-0be05f9d-905e-4ea0-940c-381856b00b6b-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "cinder-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:28 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:28 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:00:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Flow 'volume_create_manager' (a9c78a91-cc87-4c9d-9656-2531199bdad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3254634b-7da1-4c5d-83d2-4dbff02f9b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd-delete_volume" acquired by "delete_volume" :: waited 0.174s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3254634b-7da1-4c5d-83d2-4dbff02f9b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-96923671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=502af478-bc0c-427d-b248-68448fe551ca,host='devstack@QuobyteHD#QuobyteHD',id=09600a66-19ca-4f81-9698-8805811623cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306c34f9f28e4237a8326f130376bbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:29Z,use_quota=True,user_id='017ad814bbb14e62895a37ebd509dd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13be4938-85cd-40e2-a1da-6e6bf3eb7f98),volume_type_id=13be4938-85cd-40e2-a1da-6e6bf3eb7f98)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50610eb-91a5-4f31-b817-21f79fef196a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50610eb-91a5-4f31-b817-21f79fef196a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e38930-e9a9-45eb-85d5-faca1f8c0015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e38930-e9a9-45eb-85d5-faca1f8c0015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09600a66-19ca-4f81-9698-8805811623cc', 'volume_name': 'volume-09600a66-19ca-4f81-9698-8805811623cc', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e48a85b-75d8-423b-8834-ebd506ab478d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e48a85b-75d8-423b-8834-ebd506ab478d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f145c4-d27d-473c-adea-2eba705f6336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:29 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Volume 09600a66-19ca-4f81-9698-8805811623cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09600a66-19ca-4f81-9698-8805811623cc', 'volume_size': 1}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=502af478-bc0c-427d-b248-68448fe551ca,created_at=2025-09-10T12:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-96923671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=502af478-bc0c-427d-b248-68448fe551ca,host='devstack@QuobyteHD#QuobyteHD',id=09600a66-19ca-4f81-9698-8805811623cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306c34f9f28e4237a8326f130376bbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:29Z,use_quota=True,user_id='017ad814bbb14e62895a37ebd509dd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13be4938-85cd-40e2-a1da-6e6bf3eb7f98),volume_type_id=13be4938-85cd-40e2-a1da-6e6bf3eb7f98)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Creating volume 09600a66-19ca-4f81-9698-8805811623cc {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:00:29 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:29 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=80, name=volume-09600a66-19ca-4f81-9698-8805811623cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:29 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "cinder-quobyte-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc 1073741824" returned: 0 in 0.966s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd" acquired by "delete_volume" :: waited 0.291s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.716s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:00:30 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b42716-1c3c-4495-bd65-ada059d9d9ca]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc" returned: 0 in 0.445s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] <== create_volume: return (1499ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:00:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f145c4-d27d-473c-adea-2eba705f6336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09600a66-19ca-4f81-9698-8805811623cc', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ab516d-35b6-4af5-bd66-3eb8eb5433e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:30 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Volume volume-09600a66-19ca-4f81-9698-8805811623cc (09600a66-19ca-4f81-9698-8805811623cc): created successfully
Sep 10 14:00:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ab516d-35b6-4af5-bd66-3eb8eb5433e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Flow 'volume_create_manager' (a9c78a91-cc87-4c9d-9656-2531199bdad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:31 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-acc236cd-09bd-4207-8602-10e50396b1a9 tempest-GroupSnapshotsTest-1249817286 None] Created volume successfully.
Sep 10 14:00:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd" returned: 0 in 0.711s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd" returned: 0 in 0.101s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd" released by "delete_volume" :: held 1.165s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:31 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Created reservations ['ed99f0ea-1690-47f6-990f-ee6c11c8311e', 'efc1f1b0-2272-4fc3-8e38-69a7b92c86a8', 'f341f1ad-be51-49be-969a-34e7e5fc518c', '01cfd18f-5339-40d6-872b-f3d4d93305c2'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.126s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:32 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:00:32 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Deleted volume successfully.
Sep 10 14:00:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-bee6e710-876a-42c6-857d-15c6b328dd0a tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-258f94cb-e1f6-40ab-b04f-f4bdedcef3dd-delete_volume" released by "delete_volume" :: held 3.587s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "cinder-72050bd1-5dbf-439f-950e-2ad776849e27-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-72050bd1-5dbf-439f-950e-2ad776849e27-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:32 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:32 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:00:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Flow 'volume_create_manager' (34fd8fbf-62e6-49c7-8611-5f1ceaaed59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f77275b-bb84-45ba-a9b3-4ea190f82386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:33 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "cinder-quobyte-72050bd1-5dbf-439f-950e-2ad776849e27" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f77275b-bb84-45ba-a9b3-4ea190f82386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1369472322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=502af478-bc0c-427d-b248-68448fe551ca,host='devstack@QuobyteHD#QuobyteHD',id=c0f4e78e-3d21-4cc2-954b-3abe9d8d181d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306c34f9f28e4237a8326f130376bbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:33Z,use_quota=True,user_id='017ad814bbb14e62895a37ebd509dd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13be4938-85cd-40e2-a1da-6e6bf3eb7f98),volume_type_id=13be4938-85cd-40e2-a1da-6e6bf3eb7f98)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84545a0a-57ac-4fe9-b1c0-b9bc61fa39e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84545a0a-57ac-4fe9-b1c0-b9bc61fa39e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4180b78-dbda-42c2-a0b1-a864a6116501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4180b78-dbda-42c2-a0b1-a864a6116501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f4e78e-3d21-4cc2-954b-3abe9d8d181d', 'volume_name': 'volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8007cee7-07d9-464b-bc45-ab60cbf2edb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8007cee7-07d9-464b-bc45-ab60cbf2edb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3098cdc-c519-465a-a752-e3b96d5e5f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:33 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Volume c0f4e78e-3d21-4cc2-954b-3abe9d8d181d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d', 'volume_size': 1}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=502af478-bc0c-427d-b248-68448fe551ca,created_at=2025-09-10T12:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1369472322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=502af478-bc0c-427d-b248-68448fe551ca,host='devstack@QuobyteHD#QuobyteHD',id=c0f4e78e-3d21-4cc2-954b-3abe9d8d181d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306c34f9f28e4237a8326f130376bbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:33Z,use_quota=True,user_id='017ad814bbb14e62895a37ebd509dd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13be4938-85cd-40e2-a1da-6e6bf3eb7f98),volume_type_id=13be4938-85cd-40e2-a1da-6e6bf3eb7f98)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Creating volume c0f4e78e-3d21-4cc2-954b-3abe9d8d181d {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:00:33 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:33 devstack quobyte-client[82845]: System call of process 95843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:00:33 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=81, name=volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:00:33 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Flow 'volume_create_manager' (701fc213-2cb6-4efb-b082-c15071009f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7224da-ec92-4588-b517-83201fdfd966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-72050bd1-5dbf-439f-950e-2ad776849e27" acquired by "delete_volume" :: waited 0.657s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7224da-ec92-4588-b517-83201fdfd966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-407088734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655d3176-104f-4ba6-8039-795b955fda4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cffe4d95b10406da6f2846b2edee63e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:33Z,use_quota=True,user_id='91577c39ae2c44cd802f1d5405ac7ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45bcbee6-9a08-4ef0-80d6-1c26b82f5f4c),volume_type_id=45bcbee6-9a08-4ef0-80d6-1c26b82f5f4c)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e380a15-70d3-47e0-9d8d-528d9229b0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e380a15-70d3-47e0-9d8d-528d9229b0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36564e47-e915-47ec-99a6-fc49b4a39fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36564e47-e915-47ec-99a6-fc49b4a39fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '655d3176-104f-4ba6-8039-795b955fda4a', 'volume_name': 'volume-655d3176-104f-4ba6-8039-795b955fda4a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b294ecd-2b4a-4560-a753-260383bce0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b294ecd-2b4a-4560-a753-260383bce0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4870de6f-ac39-491e-9011-fc35cd79cad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:33 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Volume 655d3176-104f-4ba6-8039-795b955fda4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-655d3176-104f-4ba6-8039-795b955fda4a', 'volume_size': 1}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e9f93f-ce73-4f11-baa3-bdf6171b979c]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-72050bd1-5dbf-439f-950e-2ad776849e27 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d 1073741824" returned: 0 in 0.729s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d" returned: 0 in 0.157s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] <== create_volume: return (1027ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.508s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-407088734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655d3176-104f-4ba6-8039-795b955fda4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cffe4d95b10406da6f2846b2edee63e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:00:33Z,use_quota=True,user_id='91577c39ae2c44cd802f1d5405ac7ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45bcbee6-9a08-4ef0-80d6-1c26b82f5f4c),volume_type_id=45bcbee6-9a08-4ef0-80d6-1c26b82f5f4c)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Creating volume 655d3176-104f-4ba6-8039-795b955fda4a {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:00:34 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-655d3176-104f-4ba6-8039-795b955fda4a 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:34 devstack quobyte-client[82845]: System call of process 95848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:00:34 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=82, name=volume-655d3176-104f-4ba6-8039-795b955fda4a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3098cdc-c519-465a-a752-e3b96d5e5f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7032e4cf-9a2d-4e5c-8225-dfa37296199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-72050bd1-5dbf-439f-950e-2ad776849e27" returned: 0 in 0.944s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-72050bd1-5dbf-439f-950e-2ad776849e27 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:34 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Volume volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d (c0f4e78e-3d21-4cc2-954b-3abe9d8d181d): created successfully
Sep 10 14:00:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7032e4cf-9a2d-4e5c-8225-dfa37296199d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Flow 'volume_create_manager' (34fd8fbf-62e6-49c7-8611-5f1ceaaed59f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-655d3176-104f-4ba6-8039-795b955fda4a 1073741824" returned: 0 in 0.814s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-655d3176-104f-4ba6-8039-795b955fda4a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-72050bd1-5dbf-439f-950e-2ad776849e27" returned: 0 in 0.472s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:35 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-15862da0-a81f-42b5-b413-7412b51302ea tempest-GroupSnapshotsTest-1249817286 None] Created volume successfully.
Sep 10 14:00:35 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-72050bd1-5dbf-439f-950e-2ad776849e27" released by "delete_volume" :: held 1.854s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:35 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=101,cinder:SELECT=77,cinder:INSERT=22,cinder:DELETE=8 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:00:35 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=97,cinder:INSERT=20,cinder:UPDATE=123,cinder:DELETE=11 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:00:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-655d3176-104f-4ba6-8039-795b955fda4a" returned: 0 in 0.514s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:35 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] <== create_volume: return (1361ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:00:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:35 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-d73f3aef-1a45-47a3-b7c3-29f57c91fcee tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4870de6f-ac39-491e-9011-fc35cd79cad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-655d3176-104f-4ba6-8039-795b955fda4a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2470a29-c778-4e3b-af33-b786cbd9ef8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:00:35 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Volume volume-655d3176-104f-4ba6-8039-795b955fda4a (655d3176-104f-4ba6-8039-795b955fda4a): created successfully
Sep 10 14:00:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2470a29-c778-4e3b-af33-b786cbd9ef8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:00:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Flow 'volume_create_manager' (701fc213-2cb6-4efb-b082-c15071009f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:00:35 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-e00df268-d87a-4cff-8c40-6b588f089a57 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Created volume successfully.
Sep 10 14:00:35 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-d73f3aef-1a45-47a3-b7c3-29f57c91fcee tempest-GroupSnapshotsTest-1249817286 None] Update group completed successfully.
Sep 10 14:00:36 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Created reservations ['fa06a18a-b8da-4098-b8cb-d7836a9fafb2', '93e6d1d1-c9d3-42ff-91f5-7277a4881e2d', 'e138460a-be68-413b-81f0-8453782d6be4', '56e33fcd-d927-454e-bd97-78d1b2a85ee1'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:36 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "cinder-108264a8-01e2-458a-b9a9-1060b5aa6a2e-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.528s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:36 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-f77fc142-08a8-4e8f-a278-7d5d12276336 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:36 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:00:36 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Deleted volume successfully.
Sep 10 14:00:36 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-108264a8-01e2-458a-b9a9-1060b5aa6a2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.317s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:36 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:36 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "cinder-quobyte-51beecf7-4e94-4d6d-b3fa-01cbae96285f" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:37 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-f6c3e1cd-3e16-4fd3-a6f0-858ad362a2ae tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-51beecf7-4e94-4d6d-b3fa-01cbae96285f" acquired by "delete_snapshot" :: waited 0.104s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "cinder-quobyte-108264a8-01e2-458a-b9a9-1060b5aa6a2e" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-312ca396-d5df-4638-8107-261cce228545 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-72050bd1-5dbf-439f-950e-2ad776849e27-delete_volume" released by "delete_volume" :: held 4.212s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-108264a8-01e2-458a-b9a9-1060b5aa6a2e" acquired by "_delete_snapshot" :: waited 0.083s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Deleting offline snapshot 108264a8-01e2-458a-b9a9-1060b5aa6a2e of volume 51beecf7-4e94-4d6d-b3fa-01cbae96285f {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:00:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] snapshot_file for this snap is: volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:00:37 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[832e459f-b910-49dc-8f80-5b3fc2c41170]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:37 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f6c3e1cd-3e16-4fd3-a6f0-858ad362a2ae tempest-GroupSnapshotsTest-1249817286 None] Update group completed successfully.
Sep 10 14:00:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e" returned: 0 in 0.593s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:00:37 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cb013f-2b34-441b-a89f-8789e79c10c3]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:38 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-4e919f23-e028-444d-aa45-72ca8f43aea5 tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f77fc142-08a8-4e8f-a278-7d5d12276336 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f77fc142-08a8-4e8f-a278-7d5d12276336 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f77fc142-08a8-4e8f-a278-7d5d12276336 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f77fc142-08a8-4e8f-a278-7d5d12276336 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f77fc142-08a8-4e8f-a278-7d5d12276336 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f77fc142-08a8-4e8f-a278-7d5d12276336 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:38 devstack quobyte-client[82845]: System call of process 95859 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:00:38 devstack quobyte-client[82845]: System call of process 95859 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:00:38 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Acquiring lock "cinder-655d3176-104f-4ba6-8039-795b955fda4a-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f" returned: 0 in 1.069s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:39 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Lock "cinder-655d3176-104f-4ba6-8039-795b955fda4a-delete_volume" acquired by "delete_volume" :: waited 0.295s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f77fc142-08a8-4e8f-a278-7d5d12276336 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.789s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:39 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-f77fc142-08a8-4e8f-a278-7d5d12276336 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:00:39 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f77fc142-08a8-4e8f-a278-7d5d12276336 tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Retype volume completed successfully.
Sep 10 14:00:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e" returned: 0 in 0.493s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:39 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-4e919f23-e028-444d-aa45-72ca8f43aea5 tempest-GroupSnapshotsTest-1249817286 None] Update group completed successfully.
Sep 10 14:00:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f.108264a8-01e2-458a-b9a9-1060b5aa6a2e" returned: 0 in 0.407s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:39 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:39 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Acquiring lock "cinder-quobyte-655d3176-104f-4ba6-8039-795b955fda4a" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:39 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-108264a8-01e2-458a-b9a9-1060b5aa6a2e" released by "_delete_snapshot" :: held 2.769s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:39 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Lock "cinder-quobyte-655d3176-104f-4ba6-8039-795b955fda4a" acquired by "delete_volume" :: waited 0.085s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:39 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-51beecf7-4e94-4d6d-b3fa-01cbae96285f" released by "delete_snapshot" :: held 2.882s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:39 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c86535-54ae-4123-8138-3e61c11d12bd]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-655d3176-104f-4ba6-8039-795b955fda4a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:40 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-6f5d7a7b-b016-4900-bc61-f0393eafc582 tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:40 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Created reservations ['cea5d448-298d-4301-82ea-4e9db3d32bdf', 'caa29bea-540a-4413-afb6-98d269ee5e63', '70980972-6716-44ac-9c29-d49c8eff70ee', 'dc0a39bc-c370-4f3c-b1b2-283142277271'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-655d3176-104f-4ba6-8039-795b955fda4a" returned: 0 in 0.649s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-655d3176-104f-4ba6-8039-795b955fda4a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-655d3176-104f-4ba6-8039-795b955fda4a" returned: 0 in 0.379s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:41 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Lock "cinder-quobyte-655d3176-104f-4ba6-8039-795b955fda4a" released by "delete_volume" :: held 1.181s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:41 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-6f5d7a7b-b016-4900-bc61-f0393eafc582 tempest-GroupSnapshotsTest-1249817286 None] Update group completed successfully.
Sep 10 14:00:41 devstack cinder-volume[82823]: WARNING cinder.quota [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:00:41 devstack cinder-volume[82823]: WARNING cinder.quota [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:00:41 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Delete snapshot completed successfully.
Sep 10 14:00:41 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-63315f75-8fe4-4103-b1f0-97339662d8cf tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-108264a8-01e2-458a-b9a9-1060b5aa6a2e-delete_snapshot" released by "delete_snapshot" :: held 4.279s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:41 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Created reservations ['9ae71275-4c41-4824-bb4e-ea0c8d41b784', 'c419e173-ba6c-48e6-b44c-86e9b9ab5c28', '0bbe5888-caa5-434d-abf5-b2fd36e03122', 'fad254db-e260-490a-8788-449c1e506857'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.123s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:41 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:00:41 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Deleted volume successfully.
Sep 10 14:00:42 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6c0c627b-6c82-4cce-9fea-c5a8be352ffa tempest-VolumeRetypeWithoutMigrationTest-490427640 None] Lock "cinder-655d3176-104f-4ba6-8039-795b955fda4a-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:42 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "cinder-51beecf7-4e94-4d6d-b3fa-01cbae96285f-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:42 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-51beecf7-4e94-4d6d-b3fa-01cbae96285f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:42 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:42 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "cinder-quobyte-51beecf7-4e94-4d6d-b3fa-01cbae96285f" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:42 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-51beecf7-4e94-4d6d-b3fa-01cbae96285f" acquired by "delete_volume" :: waited 0.018s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:42 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] GroupSnapshot de649baf-5615-4876-8654-d7d81d341572: creating.
Sep 10 14:00:42 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[421a4838-bb54-40e9-89bc-365aa4d39265]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:42 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Group snapshot de649baf-5615-4876-8654-d7d81d341572: creating. {{(pid=82823) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 14:00:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Creating offline snapshot 9363d5d2-0121-4e28-8e73-f694052e141b of volume 09600a66-19ca-4f81-9698-8805811623cc {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:00:43 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc3848a-e0ea-4f39-b537-5198f13e8742]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f" returned: 0 in 0.771s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-51beecf7-4e94-4d6d-b3fa-01cbae96285f" returned: 0 in 0.285s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:43 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-quobyte-51beecf7-4e94-4d6d-b3fa-01cbae96285f" released by "delete_volume" :: held 1.336s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:43 devstack quobyte-client[82845]: System call of process 95874 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:00:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc" returned: 0 in 0.901s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:44 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=83, name=volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:00:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b 1G" returned: 0 in 0.408s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img rebase -u -b volume-09600a66-19ca-4f81-9698-8805811623cc -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:44 devstack quobyte-client[82845]: System call of process 95883 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:00:44 devstack quobyte-client[82845]: System call of process 95883 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:00:44 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Created reservations ['0d15e381-36eb-4136-8e8a-a233629f622b', '3d06003c-a334-4f45-8ffc-3a924f08ac5d', 'ca499a4e-1396-4cdc-9678-932ffda01182', 'fa653c81-9f92-402f-a030-312e9fdfcae5'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img rebase -u -b volume-09600a66-19ca-4f81-9698-8805811623cc -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b" returned: 0 in 0.537s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b" returned: 0 in 0.334s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b" returned: 0 in 0.297s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.215s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:45 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:00:45 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Deleted volume successfully.
Sep 10 14:00:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.info" returned: 0 in 0.358s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:46 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:00:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-5b7b73b8-e6d6-4328-ac95-a42bb83a9578 tempest-CreateVolumesFromSnapshotTest-1077906913 None] Lock "cinder-51beecf7-4e94-4d6d-b3fa-01cbae96285f-delete_volume" released by "delete_volume" :: held 4.112s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.info" returned: 0 in 0.279s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.366s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:00:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:00:46 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Creating offline snapshot d786746a-468a-487f-b7da-c6b17f583911 of volume c0f4e78e-3d21-4cc2-954b-3abe9d8d181d {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:00:46 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[219aa34b-bc2a-4a42-a2bd-36fd5dfd2dcd]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d" returned: 0 in 0.594s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:47 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=85, name=volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:00:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911 1G" returned: 0 in 0.353s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img rebase -u -b volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911" returned: 0 in 0.189s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:00:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911" returned: 0 in 0.122s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:00:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911" returned: 0 in 0.117s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.info" returned: 0 in 0.136s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:00:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.info" returned: 0 in 0.113s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:00:49 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-45d3759c-e927-4686-bd0f-8601eaef48c9 tempest-GroupSnapshotsTest-1249817286 None] group_snapshot de649baf-5615-4876-8654-d7d81d341572: created successfully
Sep 10 14:00:50 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] group_snapshot de649baf-5615-4876-8654-d7d81d341572: deleting
Sep 10 14:00:50 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:50 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] group_snapshot de649baf-5615-4876-8654-d7d81d341572: deleting {{(pid=82823) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 14:00:50 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "cinder-quobyte-09600a66-19ca-4f81-9698-8805811623cc" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:50 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-09600a66-19ca-4f81-9698-8805811623cc" acquired by "delete_snapshot" :: waited 0.137s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:50 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "cinder-quobyte-9363d5d2-0121-4e28-8e73-f694052e141b" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:50 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-9363d5d2-0121-4e28-8e73-f694052e141b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Deleting offline snapshot 9363d5d2-0121-4e28-8e73-f694052e141b of volume 09600a66-19ca-4f81-9698-8805811623cc {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:00:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] snapshot_file for this snap is: volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:00:50 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[db38492b-1ab8-4504-932b-64f217ab23fa]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b" returned: 0 in 0.647s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09600a66-19ca-4f81-9698-8805811623cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:00:51 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[343ebb3f-6e74-4c3e-8b51-c78fd1065fb8]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc" returned: 0 in 0.575s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b" returned: 0 in 0.275s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc.9363d5d2-0121-4e28-8e73-f694052e141b" returned: 0 in 0.186s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-9363d5d2-0121-4e28-8e73-f694052e141b" released by "_delete_snapshot" :: held 2.134s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-09600a66-19ca-4f81-9698-8805811623cc" released by "delete_snapshot" :: held 2.192s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "cinder-quobyte-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "cinder-quobyte-d786746a-468a-487f-b7da-c6b17f583911" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-d786746a-468a-487f-b7da-c6b17f583911" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Deleting offline snapshot d786746a-468a-487f-b7da-c6b17f583911 of volume c0f4e78e-3d21-4cc2-954b-3abe9d8d181d {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:00:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] snapshot_file for this snap is: volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:00:53 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf83059-8fea-4628-8457-101bf9b93d52]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:53 devstack quobyte-client[82845]: System call of process 95915 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:00:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911" returned: 0 in 0.612s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:54 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:00:54 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[649573a5-af3a-43fe-b3a8-47fe6950f262]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d" returned: 0 in 0.574s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911" returned: 0 in 0.311s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d.d786746a-468a-487f-b7da-c6b17f583911" returned: 0 in 0.113s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:55 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-d786746a-468a-487f-b7da-c6b17f583911" released by "_delete_snapshot" :: held 2.067s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:55 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d" released by "delete_snapshot" :: held 2.095s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:55 devstack cinder-volume[82823]: WARNING cinder.quota [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-671058065 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-671058065, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:00:55 devstack cinder-volume[82823]: WARNING cinder.quota [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-671058065 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-671058065, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:00:56 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Created reservations ['48fa6333-ef18-4d5f-bd24-d98461d9f7e6', 'd376031e-39fb-412a-b262-f78cc74aec95', '16dd5614-a0a8-4013-866a-d6f61d215d69', 'd734b9b8-30f4-4a84-8ae0-3e2dcb2ff64d'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:56 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] Created reservations ['32f8a091-09eb-4075-b13d-0e337a9a6bd3', '321b446c-5182-4a7d-a544-e81bfaaaee30', '05709798-b301-4605-8495-8dbd05a98d4c', '5fd60ad7-d8b8-42e4-b854-1f04e94558b2'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:00:56 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-6019eee7-f33c-4121-9f7d-e36ed75e3519 tempest-GroupSnapshotsTest-1249817286 None] group_snapshot de649baf-5615-4876-8654-d7d81d341572: deleted successfully
Sep 10 14:00:57 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:00:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "cinder-quobyte-09600a66-19ca-4f81-9698-8805811623cc" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-09600a66-19ca-4f81-9698-8805811623cc" acquired by "delete_volume" :: waited 0.019s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:57 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ef6f49-c276-4b81-a41f-32ef746f42a7]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc" returned: 0 in 0.602s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:00:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-09600a66-19ca-4f81-9698-8805811623cc" returned: 0 in 0.296s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:00:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-09600a66-19ca-4f81-9698-8805811623cc" released by "delete_volume" :: held 1.287s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:00:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "cinder-quobyte-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:00:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d" acquired by "delete_volume" :: waited 0.039s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:00:59 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8b5a96-7b12-4af9-8b6f-b7d83a8498c1]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:00:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d" returned: 0 in 0.784s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d" returned: 0 in 0.197s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-c0f4e78e-3d21-4cc2-954b-3abe9d8d181d" released by "delete_volume" :: held 1.319s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:01 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Created reservations ['19c1ef4b-605b-469d-88ff-c53d9a0bb134'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:01:01 devstack cinder-volume[82823]: WARNING cinder.quota [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-671058065 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-671058065, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:01:01 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Created reservations ['48d29fb6-72b6-4a1b-a8fc-5c38a4e490e2', '41cb919a-9b47-4f2c-804b-07a585000f4d', 'bef50d43-edee-4446-a33d-ca4eebf48bec', 'fa076ecc-ca43-4282-880f-b40aacaf8135'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:01:01 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Created reservations ['cb2bda1d-8196-41f0-b790-1f0694d144e1', '5d819f72-95b8-456d-aeba-c951d010fb59', '2ec04962-72b6-43cb-b92e-9d4a4673e197', '93799058-df6f-43f3-8fc6-1bf4b03288e5'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:01:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.127s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:02 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:01:02 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-4628c580-d04a-4a27-acd5-f61aac6e0956 tempest-GroupSnapshotsTest-1249817286 None] Delete group completed successfully.
Sep 10 14:01:03 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-f102af9b-ddc5-47de-95e4-ba3574ae03d6 tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:03 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f102af9b-ddc5-47de-95e4-ba3574ae03d6 tempest-GroupSnapshotsTest-1249817286 None] Group tempest-GroupSnapshotsTest-Group-115131721: creating
Sep 10 14:01:04 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f102af9b-ddc5-47de-95e4-ba3574ae03d6 tempest-GroupSnapshotsTest-1249817286 None] Group tempest-GroupSnapshotsTest-Group-115131721: created successfully
Sep 10 14:01:04 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f102af9b-ddc5-47de-95e4-ba3574ae03d6 tempest-GroupSnapshotsTest-1249817286 None] Create group completed successfully.
Sep 10 14:01:05 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Flow 'volume_create_manager' (411842dd-cd00-47ad-8d03-d9d85e8c255b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420b4cee-d834-47e5-8908-ecedba069fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420b4cee-d834-47e5-8908-ecedba069fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1907868192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f949091a-2ec2-4d78-bfc2-63bf73b06b16,host='devstack@QuobyteHD#QuobyteHD',id=a1947d3c-ba31-4b12-8624-8ece926d0f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306c34f9f28e4237a8326f130376bbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:06Z,use_quota=True,user_id='017ad814bbb14e62895a37ebd509dd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c607286f-e2b7-4fa3-ba09-b546bab6a1a4),volume_type_id=c607286f-e2b7-4fa3-ba09-b546bab6a1a4)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638a703d-4a20-48e8-a333-2f1195c2d4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638a703d-4a20-48e8-a333-2f1195c2d4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d6e724-6ecf-458a-8d87-b35c87b930ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d6e724-6ecf-458a-8d87-b35c87b930ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1947d3c-ba31-4b12-8624-8ece926d0f8b', 'volume_name': 'volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d880be17-342c-4279-99fc-6f9e505fe04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d880be17-342c-4279-99fc-6f9e505fe04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ba7d96-4633-46eb-bd8d-6cec386d4dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:06 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Volume a1947d3c-ba31-4b12-8624-8ece926d0f8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b', 'volume_size': 1}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f949091a-2ec2-4d78-bfc2-63bf73b06b16,created_at=2025-09-10T12:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1907868192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f949091a-2ec2-4d78-bfc2-63bf73b06b16,host='devstack@QuobyteHD#QuobyteHD',id=a1947d3c-ba31-4b12-8624-8ece926d0f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306c34f9f28e4237a8326f130376bbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:06Z,use_quota=True,user_id='017ad814bbb14e62895a37ebd509dd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c607286f-e2b7-4fa3-ba09-b546bab6a1a4),volume_type_id=c607286f-e2b7-4fa3-ba09-b546bab6a1a4)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Creating volume a1947d3c-ba31-4b12-8624-8ece926d0f8b {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:01:06 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:06 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=87, name=volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b 1073741824" returned: 0 in 0.503s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b" returned: 0 in 0.131s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] <== create_volume: return (731ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:01:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ba7d96-4633-46eb-bd8d-6cec386d4dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fefabc-e90f-4a8f-a68d-b268832893e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:07 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Volume volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b (a1947d3c-ba31-4b12-8624-8ece926d0f8b): created successfully
Sep 10 14:01:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fefabc-e90f-4a8f-a68d-b268832893e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:07 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Flow 'volume_create_manager' (411842dd-cd00-47ad-8d03-d9d85e8c255b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:07 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-5fff66ca-edf3-4b99-8430-2cf32542cd2e tempest-GroupSnapshotsTest-1249817286 None] Created volume successfully.
Sep 10 14:01:09 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] GroupSnapshot dd0e1606-9e8e-4376-9fd1-550867863a42: creating.
Sep 10 14:01:09 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] Group snapshot dd0e1606-9e8e-4376-9fd1-550867863a42: creating. {{(pid=82823) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 14:01:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:09 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] Creating offline snapshot bf28c616-0e26-4d1e-9b21-a3a60de1595e of volume a1947d3c-ba31-4b12-8624-8ece926d0f8b {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:01:09 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc913959-ea62-4d1a-8d10-598d2ee3f40e]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b" returned: 0 in 0.624s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:10 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=88, name=volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:01:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e 1G" returned: 0 in 0.293s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img rebase -u -b volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e" returned: 0 in 0.175s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:01:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e" returned: 0 in 0.136s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:01:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e" returned: 0 in 0.110s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.info" returned: 0 in 0.148s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:01:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.info" returned: 0 in 0.509s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.441s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:11 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:11 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:01:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Flow 'volume_create_manager' (18b0f5b4-0866-498a-be7a-1473c8df9091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bac4d6-2268-408e-a70d-03ec21bfe810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bac4d6-2268-408e-a70d-03ec21bfe810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1899445620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf54f1f2-4184-495c-a896-4bb85f64566d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f571868ca89492bad15b321bb9e4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:11Z,use_quota=True,user_id='4d41a5daa0da4b35880a3e3f71882eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3529c7-5895-4003-8d05-ad9fe48a04e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3529c7-5895-4003-8d05-ad9fe48a04e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4516a907-68fe-4c01-99e9-b253dbf21157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4516a907-68fe-4c01-99e9-b253dbf21157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf54f1f2-4184-495c-a896-4bb85f64566d', 'volume_name': 'volume-cf54f1f2-4184-495c-a896-4bb85f64566d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a912f0-182c-45b2-9d61-2aead1da4258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a912f0-182c-45b2-9d61-2aead1da4258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0283a91a-8031-46ca-8151-d710acca4d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:12 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Volume cf54f1f2-4184-495c-a896-4bb85f64566d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf54f1f2-4184-495c-a896-4bb85f64566d', 'volume_size': 1}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1899445620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf54f1f2-4184-495c-a896-4bb85f64566d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f571868ca89492bad15b321bb9e4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:11Z,use_quota=True,user_id='4d41a5daa0da4b35880a3e3f71882eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Creating volume cf54f1f2-4184-495c-a896-4bb85f64566d {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:01:12 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:01:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-cf54f1f2-4184-495c-a896-4bb85f64566d 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:12 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=90, name=volume-cf54f1f2-4184-495c-a896-4bb85f64566d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:01:13 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] group_snapshot dd0e1606-9e8e-4376-9fd1-550867863a42: deleting
Sep 10 14:01:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-cf54f1f2-4184-495c-a896-4bb85f64566d 1073741824" returned: 0 in 1.099s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-cf54f1f2-4184-495c-a896-4bb85f64566d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:13 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:13 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] group_snapshot dd0e1606-9e8e-4376-9fd1-550867863a42: deleting {{(pid=82823) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 14:01:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-cf54f1f2-4184-495c-a896-4bb85f64566d" returned: 0 in 0.516s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:13 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] <== create_volume: return (1672ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:01:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:13 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-77eb38df-e993-4045-ac04-81b2cdbf0490 tempest-GroupSnapshotsTest-1249817286 None] group_snapshot dd0e1606-9e8e-4376-9fd1-550867863a42: created successfully
Sep 10 14:01:13 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0283a91a-8031-46ca-8151-d710acca4d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf54f1f2-4184-495c-a896-4bb85f64566d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:13 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29638af6-a4a0-48a0-a285-b1a964af4f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "cinder-quobyte-a1947d3c-ba31-4b12-8624-8ece926d0f8b" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:14 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Volume volume-cf54f1f2-4184-495c-a896-4bb85f64566d (cf54f1f2-4184-495c-a896-4bb85f64566d): created successfully
Sep 10 14:01:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29638af6-a4a0-48a0-a285-b1a964af4f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Flow 'volume_create_manager' (18b0f5b4-0866-498a-be7a-1473c8df9091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-a1947d3c-ba31-4b12-8624-8ece926d0f8b" acquired by "delete_snapshot" :: waited 0.096s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "cinder-quobyte-bf28c616-0e26-4d1e-9b21-a3a60de1595e" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:14 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-93f7feb7-67a7-4d7b-ae74-ee24d83d0d02 tempest-VolumesListAdminTestJSON-988353150 None] Created volume successfully.
Sep 10 14:01:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-bf28c616-0e26-4d1e-9b21-a3a60de1595e" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Deleting offline snapshot bf28c616-0e26-4d1e-9b21-a3a60de1595e of volume a1947d3c-ba31-4b12-8624-8ece926d0f8b {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:01:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] snapshot_file for this snap is: volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:01:14 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3931d9-d277-4303-92b6-c65fde0b88e3]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e" returned: 0 in 0.575s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:01:14 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a762a9-b4a7-4b0b-af0e-cd4841c961ed]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b" returned: 0 in 0.871s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:15 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:15 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Flow 'volume_create_manager' (7b1bb240-a9d3-4d4a-bc4d-a1cc815c894a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddc88da-fbb6-45f9-8302-dcc1372bcc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ddc88da-fbb6-45f9-8302-dcc1372bcc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-392540331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb3de4a-40f3-46da-b9d1-db0ad1b57468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f571868ca89492bad15b321bb9e4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:15Z,use_quota=True,user_id='4d41a5daa0da4b35880a3e3f71882eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b82f13f-bd5a-4dff-b3af-776d7217425d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b82f13f-bd5a-4dff-b3af-776d7217425d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad38a110-302f-4cd6-9644-f36f1aae85f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad38a110-302f-4cd6-9644-f36f1aae85f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb3de4a-40f3-46da-b9d1-db0ad1b57468', 'volume_name': 'volume-bdb3de4a-40f3-46da-b9d1-db0ad1b57468', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c61bb99-b994-40e7-a1fb-b221c7f4940e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c61bb99-b994-40e7-a1fb-b221c7f4940e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ad9bd3-b59c-4c20-bff8-6c8e36fde5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:16 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Volume bdb3de4a-40f3-46da-b9d1-db0ad1b57468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb3de4a-40f3-46da-b9d1-db0ad1b57468', 'volume_size': 1}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-392540331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb3de4a-40f3-46da-b9d1-db0ad1b57468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f571868ca89492bad15b321bb9e4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:15Z,use_quota=True,user_id='4d41a5daa0da4b35880a3e3f71882eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Creating volume bdb3de4a-40f3-46da-b9d1-db0ad1b57468 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:01:16 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bdb3de4a-40f3-46da-b9d1-db0ad1b57468 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e" returned: 0 in 0.890s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:16 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=91, name=volume-bdb3de4a-40f3-46da-b9d1-db0ad1b57468, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:01:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b.bf28c616-0e26-4d1e-9b21-a3a60de1595e" returned: 0 in 0.335s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bdb3de4a-40f3-46da-b9d1-db0ad1b57468 1073741824" returned: 0 in 0.625s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bdb3de4a-40f3-46da-b9d1-db0ad1b57468 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-bf28c616-0e26-4d1e-9b21-a3a60de1595e" released by "_delete_snapshot" :: held 3.195s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bdb3de4a-40f3-46da-b9d1-db0ad1b57468" returned: 0 in 0.236s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:17 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] <== create_volume: return (893ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:01:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-a1947d3c-ba31-4b12-8624-8ece926d0f8b" released by "delete_snapshot" :: held 3.523s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ad9bd3-b59c-4c20-bff8-6c8e36fde5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb3de4a-40f3-46da-b9d1-db0ad1b57468', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5f19bf-4193-4ced-90bb-017179c1b1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:17 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Volume volume-bdb3de4a-40f3-46da-b9d1-db0ad1b57468 (bdb3de4a-40f3-46da-b9d1-db0ad1b57468): created successfully
Sep 10 14:01:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5f19bf-4193-4ced-90bb-017179c1b1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Flow 'volume_create_manager' (7b1bb240-a9d3-4d4a-bc4d-a1cc815c894a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:17 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-9f1d4184-fbf6-4b71-8301-bf29944f088e tempest-VolumesListAdminTestJSON-988353150 None] Created volume successfully.
Sep 10 14:01:18 devstack cinder-volume[82823]: WARNING cinder.quota [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-990923862 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-990923862, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:01:18 devstack cinder-volume[82823]: WARNING cinder.quota [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-990923862 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-990923862, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:01:18 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] Created reservations ['156306af-77dd-4327-bb84-81eba6603834', 'df448bbc-4e7b-4be1-8465-f375793d4efa', '53fad8ab-418c-4fd5-99ea-a16e7a1ff4eb', '6d497351-0431-4a7f-900f-c91c258c9580'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:01:18 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-0519fa02-6e9a-42bd-993d-4bbcd771d3c9 tempest-GroupSnapshotsTest-1249817286 None] group_snapshot dd0e1606-9e8e-4376-9fd1-550867863a42: deleted successfully
Sep 10 14:01:19 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:19 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "cinder-quobyte-a1947d3c-ba31-4b12-8624-8ece926d0f8b" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:19 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-a1947d3c-ba31-4b12-8624-8ece926d0f8b" acquired by "delete_volume" :: waited 0.033s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:19 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0c3169-79d6-4b95-8871-0f29e0967bb0]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:20 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Flow 'volume_create_manager' (93b70644-22a2-4ab6-aec0-cb4c3f90cdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ff2a86-5153-49c3-b3fa-482d35a2c6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ff2a86-5153-49c3-b3fa-482d35a2c6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-367987477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d73931a-6c31-462e-a651-ecc97d89e363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f571868ca89492bad15b321bb9e4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:20Z,use_quota=True,user_id='4d41a5daa0da4b35880a3e3f71882eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9a45a9-8e24-4f19-9463-d456e0ef26c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9a45a9-8e24-4f19-9463-d456e0ef26c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a633aba3-4fc8-428a-a072-ff55cdadc0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a633aba3-4fc8-428a-a072-ff55cdadc0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d73931a-6c31-462e-a651-ecc97d89e363', 'volume_name': 'volume-0d73931a-6c31-462e-a651-ecc97d89e363', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8f5585-a364-4baf-8280-5cf327fb4413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8f5585-a364-4baf-8280-5cf327fb4413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3760a6d5-8e5d-4a29-8544-ac95932e5130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:20 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Volume 0d73931a-6c31-462e-a651-ecc97d89e363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d73931a-6c31-462e-a651-ecc97d89e363', 'volume_size': 1}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-367987477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d73931a-6c31-462e-a651-ecc97d89e363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f571868ca89492bad15b321bb9e4c02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:20Z,use_quota=True,user_id='4d41a5daa0da4b35880a3e3f71882eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Creating volume 0d73931a-6c31-462e-a651-ecc97d89e363 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:01:20 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0d73931a-6c31-462e-a651-ecc97d89e363 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:20 devstack quobyte-client[82845]: System call of process 96008 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:01:20 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=92, name=volume-0d73931a-6c31-462e-a651-ecc97d89e363, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b" returned: 0 in 0.973s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a1947d3c-ba31-4b12-8624-8ece926d0f8b" returned: 0 in 0.211s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:21 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Lock "cinder-quobyte-a1947d3c-ba31-4b12-8624-8ece926d0f8b" released by "delete_volume" :: held 1.479s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0d73931a-6c31-462e-a651-ecc97d89e363 1073741824" returned: 0 in 0.763s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0d73931a-6c31-462e-a651-ecc97d89e363 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0d73931a-6c31-462e-a651-ecc97d89e363" returned: 0 in 0.295s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] <== create_volume: return (1099ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:01:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3760a6d5-8e5d-4a29-8544-ac95932e5130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d73931a-6c31-462e-a651-ecc97d89e363', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977737ab-b9b0-40af-b2a5-1c8302d8afde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:21 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Volume volume-0d73931a-6c31-462e-a651-ecc97d89e363 (0d73931a-6c31-462e-a651-ecc97d89e363): created successfully
Sep 10 14:01:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977737ab-b9b0-40af-b2a5-1c8302d8afde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Flow 'volume_create_manager' (93b70644-22a2-4ab6-aec0-cb4c3f90cdad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:21 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-eba4c277-fe9e-44d7-ae20-2daee55977b0 tempest-VolumesListAdminTestJSON-988353150 None] Created volume successfully.
Sep 10 14:01:21 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Created reservations ['a837150d-5397-4561-a97a-cc366aad16e0'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:01:21 devstack cinder-volume[82823]: WARNING cinder.quota [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-990923862 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-990923862, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:01:21 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Created reservations ['ce5df1bf-d9d5-42be-a6d6-3ad9cc4612e2', '93e0653d-65ae-4992-8915-46f6068c7088', '0ebb6b63-3cd2-413c-93ef-8dca8fe99ded', 'acca2d8f-923c-415b-897b-17f317ab35f8'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:01:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:22 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:22 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.123s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:22 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:01:22 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-17ad73e2-dbac-41a4-9310-e49f4e40ac17 tempest-GroupSnapshotsTest-1249817286 None] Delete group completed successfully.
Sep 10 14:01:24 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Flow 'volume_create_manager' (02cf8d52-c313-4a13-9e1e-e9533844bb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af386987-4a86-4309-82fe-6c497285caa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af386987-4a86-4309-82fe-6c497285caa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98caa8b-fc11-41d8-a645-25006b8e6518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1020db52cf44669a3ede96671f489f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:24Z,use_quota=True,user_id='544f71e6e9714b22b23242c7b4644cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220c3fe8-f412-40dd-aa60-f42b8906f3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220c3fe8-f412-40dd-aa60-f42b8906f3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7571dfb2-f6e3-4d31-9017-703f95670ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7571dfb2-f6e3-4d31-9017-703f95670ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a98caa8b-fc11-41d8-a645-25006b8e6518', 'volume_name': 'volume-a98caa8b-fc11-41d8-a645-25006b8e6518', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e3622f-617b-4b47-8bd8-463f90d9a77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e3622f-617b-4b47-8bd8-463f90d9a77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9a7157-88ba-4017-b1a6-0f4904098c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:24 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Volume a98caa8b-fc11-41d8-a645-25006b8e6518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a98caa8b-fc11-41d8-a645-25006b8e6518', 'volume_size': 1}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98caa8b-fc11-41d8-a645-25006b8e6518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1020db52cf44669a3ede96671f489f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:24Z,use_quota=True,user_id='544f71e6e9714b22b23242c7b4644cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Creating volume a98caa8b-fc11-41d8-a645-25006b8e6518 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:01:24 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a98caa8b-fc11-41d8-a645-25006b8e6518 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:24 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=93, name=volume-a98caa8b-fc11-41d8-a645-25006b8e6518, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:01:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a98caa8b-fc11-41d8-a645-25006b8e6518 1073741824" returned: 0 in 0.556s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a98caa8b-fc11-41d8-a645-25006b8e6518 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:25 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Flow 'volume_create_manager' (236a539f-969f-41a4-8bfb-ca4d76614bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea8e821-7e6d-41d5-965f-cb44dcec0848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea8e821-7e6d-41d5-965f-cb44dcec0848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1827093624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be12c29c-2374-483d-8e3a-a008bdf76af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200468594ae34e8fafab068c385e5e32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:24Z,use_quota=True,user_id='5eb8ef51024144fea3b11536892a64c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9eab211-477b-4e6d-8143-72c698d3aa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9eab211-477b-4e6d-8143-72c698d3aa0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61c9659-a995-4aba-8610-2a8db9ec8ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61c9659-a995-4aba-8610-2a8db9ec8ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be12c29c-2374-483d-8e3a-a008bdf76af9', 'volume_name': 'volume-be12c29c-2374-483d-8e3a-a008bdf76af9', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ed20d4-e93b-4743-8c8d-9e822e153402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ed20d4-e93b-4743-8c8d-9e822e153402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417a5fc7-249e-4170-a1e9-c18becc91376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:25 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Volume be12c29c-2374-483d-8e3a-a008bdf76af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be12c29c-2374-483d-8e3a-a008bdf76af9', 'volume_size': 1}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a98caa8b-fc11-41d8-a645-25006b8e6518" returned: 0 in 0.573s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] <== create_volume: return (1160ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.042s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1827093624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be12c29c-2374-483d-8e3a-a008bdf76af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200468594ae34e8fafab068c385e5e32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:24Z,use_quota=True,user_id='5eb8ef51024144fea3b11536892a64c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Creating volume be12c29c-2374-483d-8e3a-a008bdf76af9 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:01:25 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:25 devstack quobyte-client[82845]: System call of process 96019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:01:25 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=94, name=volume-be12c29c-2374-483d-8e3a-a008bdf76af9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9a7157-88ba-4017-b1a6-0f4904098c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a98caa8b-fc11-41d8-a645-25006b8e6518', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fa4ffd-7245-4c34-ae8f-87e470c31552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9 1073741824" returned: 0 in 0.568s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:26 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Volume volume-a98caa8b-fc11-41d8-a645-25006b8e6518 (a98caa8b-fc11-41d8-a645-25006b8e6518): created successfully
Sep 10 14:01:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fa4ffd-7245-4c34-ae8f-87e470c31552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Flow 'volume_create_manager' (02cf8d52-c313-4a13-9e1e-e9533844bb6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9" returned: 0 in 0.492s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:26 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] <== create_volume: return (1092ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:01:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:26 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-4555a6d4-8979-4f8a-9f6b-37144ab6e86c tempest-VolumesListAdminTestJSON-64488071 None] Created volume successfully.
Sep 10 14:01:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417a5fc7-249e-4170-a1e9-c18becc91376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be12c29c-2374-483d-8e3a-a008bdf76af9', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85bf8773-96b0-4549-ac5a-46fe923010ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:26 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Volume volume-be12c29c-2374-483d-8e3a-a008bdf76af9 (be12c29c-2374-483d-8e3a-a008bdf76af9): created successfully
Sep 10 14:01:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85bf8773-96b0-4549-ac5a-46fe923010ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Flow 'volume_create_manager' (236a539f-969f-41a4-8bfb-ca4d76614bac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:26 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-31e0749a-b34b-43c5-90eb-87dc17832ffb tempest-SnapshotDependencyTests-101293509 None] Created volume successfully.
Sep 10 14:01:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Acquiring lock "cinder-a98caa8b-fc11-41d8-a645-25006b8e6518-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Lock "cinder-a98caa8b-fc11-41d8-a645-25006b8e6518-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:27 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Acquiring lock "cinder-quobyte-a98caa8b-fc11-41d8-a645-25006b8e6518" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Lock "cinder-quobyte-a98caa8b-fc11-41d8-a645-25006b8e6518" acquired by "delete_volume" :: waited 0.028s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Acquiring lock "cinder-0d73931a-6c31-462e-a651-ecc97d89e363-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:27 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[672d1470-7829-4433-8eac-e484119d55f3]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a98caa8b-fc11-41d8-a645-25006b8e6518 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Lock "cinder-0d73931a-6c31-462e-a651-ecc97d89e363-delete_volume" acquired by "delete_volume" :: waited 0.312s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:28 devstack quobyte-client[82845]: System call of process 96031 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:01:28 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Acquiring lock "cinder-quobyte-0d73931a-6c31-462e-a651-ecc97d89e363" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:28 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a98caa8b-fc11-41d8-a645-25006b8e6518" returned: 0 in 0.836s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a98caa8b-fc11-41d8-a645-25006b8e6518 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] Creating offline snapshot 3a210032-7f98-49ac-b3c9-e5f5453ecd6f of volume be12c29c-2374-483d-8e3a-a008bdf76af9 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:01:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Lock "cinder-quobyte-0d73931a-6c31-462e-a651-ecc97d89e363" acquired by "delete_volume" :: waited 0.422s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a98caa8b-fc11-41d8-a645-25006b8e6518" returned: 0 in 0.411s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:29 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d1a395-d2e9-4217-aa80-276c51fdd41e]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:29 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dc8952-8dd4-4b0a-b3aa-c6715095ea0c]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0d73931a-6c31-462e-a651-ecc97d89e363 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Lock "cinder-quobyte-a98caa8b-fc11-41d8-a645-25006b8e6518" released by "delete_volume" :: held 1.630s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 14:01:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:30 devstack quobyte-client[82845]: System call of process 96036 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:01:30 devstack quobyte-client[82845]: System call of process 96036 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:01:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9" returned: 0 in 1.146s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.560s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0d73931a-6c31-462e-a651-ecc97d89e363" returned: 0 in 1.219s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:30 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=95, name=volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:01:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:01:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0d73931a-6c31-462e-a651-ecc97d89e363 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0d73931a-6c31-462e-a651-ecc97d89e363" returned: 0 in 0.311s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f 1G" returned: 0 in 0.707s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): qemu-img rebase -u -b volume-be12c29c-2374-483d-8e3a-a008bdf76af9 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] CMD "qemu-img rebase -u -b volume-be12c29c-2374-483d-8e3a-a008bdf76af9 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f" returned: 0 in 0.233s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Lock "cinder-quobyte-0d73931a-6c31-462e-a651-ecc97d89e363" released by "delete_volume" :: held 2.228s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:01:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:31 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Created reservations ['4a030ea7-04d9-4b89-8c8d-42a0c693505a', '84bc60eb-7e38-4c08-b8d7-16844a765601', 'c4af5826-2636-4f05-8436-4fc709169f2e', '0b0e4566-daa7-417a-b281-19e797648573'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:01:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f" returned: 0 in 0.437s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:01:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f" returned: 0 in 0.431s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:32 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Created reservations ['75478860-adb9-44f8-8cd6-589075037823', '16df0f94-1537-4dcb-a8cd-4acb59c68255', '78b63986-5459-4f51-8dc1-7e372c7a8bb0', '407eb9d1-e649-4959-9b72-5afa3a285043'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:01:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.info" returned: 0 in 0.524s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:01:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:33 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-45ef39b8-b9da-4560-8667-4ff5c9b3b7d7 tempest-GroupSnapshotsV319Test-1433911491 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:33 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-45ef39b8-b9da-4560-8667-4ff5c9b3b7d7 tempest-GroupSnapshotsV319Test-1433911491 None] Group tempest-GroupSnapshotsV319Test-Group-851801995: creating
Sep 10 14:01:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.info" returned: 0 in 0.368s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.583s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:33 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-45ef39b8-b9da-4560-8667-4ff5c9b3b7d7 tempest-GroupSnapshotsV319Test-1433911491 None] Group tempest-GroupSnapshotsV319Test-Group-851801995: created successfully
Sep 10 14:01:33 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-45ef39b8-b9da-4560-8667-4ff5c9b3b7d7 tempest-GroupSnapshotsV319Test-1433911491 None] Create group completed successfully.
Sep 10 14:01:33 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b8f8daf1-1e69-439f-8c0f-f9d6c1de2653 tempest-SnapshotDependencyTests-101293509 None] Create snapshot completed successfully
Sep 10 14:01:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Acquiring lock "cinder-bdb3de4a-40f3-46da-b9d1-db0ad1b57468-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.623s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:34 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:01:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.412s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:34 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:01:34 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Deleted volume successfully.
Sep 10 14:01:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Lock "cinder-bdb3de4a-40f3-46da-b9d1-db0ad1b57468-delete_volume" acquired by "delete_volume" :: waited 0.227s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:34 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Deleted volume successfully.
Sep 10 14:01:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-105cb8d0-3b04-4007-b093-bdb311dd1618 tempest-VolumesListAdminTestJSON-64488071 None] Lock "cinder-a98caa8b-fc11-41d8-a645-25006b8e6518-delete_volume" released by "delete_volume" :: held 6.763s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b0fb99d9-6ea0-45f6-8cc6-0e24e6601736 tempest-VolumesListAdminTestJSON-988353150 None] Lock "cinder-0d73931a-6c31-462e-a651-ecc97d89e363-delete_volume" released by "delete_volume" :: held 6.135s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:34 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Acquiring lock "cinder-quobyte-bdb3de4a-40f3-46da-b9d1-db0ad1b57468" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Lock "cinder-quobyte-bdb3de4a-40f3-46da-b9d1-db0ad1b57468" acquired by "delete_volume" :: waited 0.025s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:34 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e79bfc-6032-4178-89b7-c1934bd17924]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bdb3de4a-40f3-46da-b9d1-db0ad1b57468 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:35 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Flow 'volume_create_manager' (4ebd126a-fd9c-4ddd-9cb6-a1248fac2fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0f5d1a-2247-43f6-bddb-245a1f423055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0f5d1a-2247-43f6-bddb-245a1f423055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-660572988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=01466278-3c63-4320-806f-2d4a47834ca0,host='devstack@QuobyteHD#QuobyteHD',id=c4a3c229-2856-4ced-be5b-6fb1745fa17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed86e7c46424a05b3a1145ba3bb9bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:35Z,use_quota=True,user_id='428ad567b7d94acc896bbb27d86c6873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(760f50e6-ffc0-4e9c-afe0-cb4dc40ebb2b),volume_type_id=760f50e6-ffc0-4e9c-afe0-cb4dc40ebb2b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b19a810-19e6-4454-a783-436288f57660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b19a810-19e6-4454-a783-436288f57660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c052b837-0f5c-49a7-86f7-416df637fc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c052b837-0f5c-49a7-86f7-416df637fc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4a3c229-2856-4ced-be5b-6fb1745fa17f', 'volume_name': 'volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160cd4ac-c886-4596-93a7-e3487734cdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160cd4ac-c886-4596-93a7-e3487734cdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fab333-e7a9-4d5a-bd22-9d5b76f7a9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:35 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Volume c4a3c229-2856-4ced-be5b-6fb1745fa17f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f', 'volume_size': 1}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=01466278-3c63-4320-806f-2d4a47834ca0,created_at=2025-09-10T12:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-660572988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=01466278-3c63-4320-806f-2d4a47834ca0,host='devstack@QuobyteHD#QuobyteHD',id=c4a3c229-2856-4ced-be5b-6fb1745fa17f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed86e7c46424a05b3a1145ba3bb9bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:35Z,use_quota=True,user_id='428ad567b7d94acc896bbb27d86c6873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(760f50e6-ffc0-4e9c-afe0-cb4dc40ebb2b),volume_type_id=760f50e6-ffc0-4e9c-afe0-cb4dc40ebb2b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Creating volume c4a3c229-2856-4ced-be5b-6fb1745fa17f {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:01:35 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:35 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=97, name=volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bdb3de4a-40f3-46da-b9d1-db0ad1b57468" returned: 0 in 1.313s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bdb3de4a-40f3-46da-b9d1-db0ad1b57468 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:36 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f 1073741824" returned: 0 in 0.720s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bdb3de4a-40f3-46da-b9d1-db0ad1b57468" returned: 0 in 0.396s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Flow 'volume_create_manager' (ab6d5e39-b962-40b7-9a0b-2ce372658e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3773d8b4-75cf-495b-8990-e69e020d8804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:DELETE=8,cinder:SELECT=113,cinder:INSERT=30,cinder:UPDATE=103 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3773d8b4-75cf-495b-8990-e69e020d8804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169ebdc8-215b-4448-afa9-7913ffb8688c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200468594ae34e8fafab068c385e5e32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3a210032-7f98-49ac-b3c9-e5f5453ecd6f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:35Z,use_quota=True,user_id='5eb8ef51024144fea3b11536892a64c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1f34bc-31b7-46eb-adcf-dbbd2ef2487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1f34bc-31b7-46eb-adcf-dbbd2ef2487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757c1b0a-a706-4b85-a4d2-1a6eab74f241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757c1b0a-a706-4b85-a4d2-1a6eab74f241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '169ebdc8-215b-4448-afa9-7913ffb8688c', 'volume_name': 'volume-169ebdc8-215b-4448-afa9-7913ffb8688c', 'volume_size': 1, 'snapshot_id': '3a210032-7f98-49ac-b3c9-e5f5453ecd6f'}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0863ce21-c9d8-4225-a89f-1c11bf8233f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0863ce21-c9d8-4225-a89f-1c11bf8233f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136f3768-2089-477a-ad9a-e0815f85cffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:36 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Volume 169ebdc8-215b-4448-afa9-7913ffb8688c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-169ebdc8-215b-4448-afa9-7913ffb8688c', 'volume_size': 1, 'snapshot_id': '3a210032-7f98-49ac-b3c9-e5f5453ecd6f'}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Lock "cinder-quobyte-bdb3de4a-40f3-46da-b9d1-db0ad1b57468" released by "delete_volume" :: held 2.244s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=107,cinder:UPDATE=146,cinder:INSERT=20,cinder:DELETE=5 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f" returned: 0 in 0.557s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] <== create_volume: return (1300ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "cinder-quobyte-3a210032-7f98-49ac-b3c9-e5f5453ecd6f-169ebdc8-215b-4448-afa9-7913ffb8688c" by "_create_volume_from_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fab333-e7a9-4d5a-bd22-9d5b76f7a9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6c4bb8-05bd-47c7-839a-49823cbed0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:36 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Volume volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f (c4a3c229-2856-4ced-be5b-6fb1745fa17f): created successfully
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6c4bb8-05bd-47c7-839a-49823cbed0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Flow 'volume_create_manager' (4ebd126a-fd9c-4ddd-9cb6-a1248fac2fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-quobyte-3a210032-7f98-49ac-b3c9-e5f5453ecd6f-169ebdc8-215b-4448-afa9-7913ffb8688c" acquired by "_create_volume_from_snapshot" :: waited 0.074s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Creating volume 169ebdc8-215b-4448-afa9-7913ffb8688c from snapshot 3a210032-7f98-49ac-b3c9-e5f5453ecd6f {{(pid=82823) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "cinder-quobyte-169ebdc8-215b-4448-afa9-7913ffb8688c" by "_copy_volume_from_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:36 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f6433f13-22a1-4d94-b061-a530458941cd tempest-GroupSnapshotsV319Test-1433911491 None] Created volume successfully.
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-quobyte-169ebdc8-215b-4448-afa9-7913ffb8688c" acquired by "_copy_volume_from_snapshot" :: waited 0.060s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] snapshot: 3a210032-7f98-49ac-b3c9-e5f5453ecd6f, volume: 169ebdc8-215b-4448-afa9-7913ffb8688c,  {{(pid=82823) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[f118dbc0-7677-41b5-b0d7-d37595dd9302]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:37 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Created reservations ['b24493cd-6669-4aaa-b62b-e213107b7e2e', '58aa2690-85f1-4a52-a234-3c6da187462a', '59ee479c-dc86-4f0c-b940-bddc3da5f6dd', 'f26b8bcb-23e1-4b80-80d3-872ed758df12'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:01:37 devstack quobyte-client[82845]: System call of process 96064 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:01:37 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] GroupSnapshot 217bbc17-4a8a-4451-bea5-4a91801a7c6c: creating.
Sep 10 14:01:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f" returned: 0 in 0.714s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be12c29c-2374-483d-8e3a-a008bdf76af9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:01:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9 {{(pid=82823) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 14:01:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Creating direct copy from snapshot {{(pid=82823) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 14:01:37 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] Group snapshot 217bbc17-4a8a-4451-bea5-4a91801a7c6c: creating. {{(pid=82823) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 14:01:37 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5abac57-f02c-4d5a-9964-9e03e3be4366]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.116s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:38 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:01:38 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Deleted volume successfully.
Sep 10 14:01:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9" returned: 0 in 0.667s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:38 devstack cinder-volume[82823]: DEBUG cinder.utils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169ebdc8-215b-4448-afa9-7913ffb8688c not found in is_blk_device check {{(pid=82823) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 14:01:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169ebdc8-215b-4448-afa9-7913ffb8688c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:38 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=98, name=volume-169ebdc8-215b-4448-afa9-7913ffb8688c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:01:38 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0b46d8c5-d368-4a8d-86df-f8cec4f2c53f tempest-VolumesListAdminTestJSON-988353150 None] Lock "cinder-bdb3de4a-40f3-46da-b9d1-db0ad1b57468-delete_volume" released by "delete_volume" :: held 4.420s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:38 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Acquiring lock "cinder-cf54f1f2-4184-495c-a896-4bb85f64566d-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:39 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Lock "cinder-cf54f1f2-4184-495c-a896-4bb85f64566d-delete_volume" acquired by "delete_volume" :: waited 0.137s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:39 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:39 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Acquiring lock "cinder-quobyte-cf54f1f2-4184-495c-a896-4bb85f64566d" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:40 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Lock "cinder-quobyte-cf54f1f2-4184-495c-a896-4bb85f64566d" acquired by "delete_volume" :: waited 0.075s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:40 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d8aa82-fa25-4565-bf72-f556d4fdac66]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-cf54f1f2-4184-495c-a896-4bb85f64566d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:41 devstack quobyte-client[82845]: System call of process 96081 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:01:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-cf54f1f2-4184-495c-a896-4bb85f64566d" returned: 0 in 1.766s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-cf54f1f2-4184-495c-a896-4bb85f64566d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-cf54f1f2-4184-495c-a896-4bb85f64566d" returned: 0 in 0.459s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:42 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Lock "cinder-quobyte-cf54f1f2-4184-495c-a896-4bb85f64566d" released by "delete_volume" :: held 2.819s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:43 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Created reservations ['4ce1e394-26f6-481b-ab56-4de94361b7b6', 'd7899745-1005-4afa-8206-42c61ff3813b', '7e22e2dc-ab57-4875-abfd-686d42befe3c', 'c5cb9684-be8b-4d57-9df1-af1e660916a7'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:01:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:44 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:44 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.464s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:45 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:01:45 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Deleted volume successfully.
Sep 10 14:01:45 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0094477b-6f5b-43f3-8520-c34f8914a60a tempest-VolumesListAdminTestJSON-988353150 None] Lock "cinder-cf54f1f2-4184-495c-a896-4bb85f64566d-delete_volume" released by "delete_volume" :: held 6.960s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169ebdc8-215b-4448-afa9-7913ffb8688c" returned: 0 in 7.577s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:46 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aba92d-4a2d-4486-9de9-8a337384466e]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9" returned: 0 in 0.649s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:46 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9, size 1024.00 MB, duration 7.58 sec, destination /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169ebdc8-215b-4448-afa9-7913ffb8688c {{(pid=82823) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 14:01:46 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Converted 1024.00 MB image at 135.06 MB/s
Sep 10 14:01:46 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169ebdc8-215b-4448-afa9-7913ffb8688c is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:01:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169ebdc8-215b-4448-afa9-7913ffb8688c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169ebdc8-215b-4448-afa9-7913ffb8688c" returned: 0 in 0.109s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-quobyte-169ebdc8-215b-4448-afa9-7913ffb8688c" released by "_copy_volume_from_snapshot" :: held 10.118s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-quobyte-3a210032-7f98-49ac-b3c9-e5f5453ecd6f-169ebdc8-215b-4448-afa9-7913ffb8688c" released by "_create_volume_from_snapshot" :: held 10.213s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.299s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.429s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] Creating offline snapshot ed635fa1-861d-46ce-a6d2-ffb163846145 of volume c4a3c229-2856-4ced-be5b-6fb1745fa17f {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:01:47 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[15de0a27-0b81-4b39-a88f-9e33b0650edb]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136f3768-2089-477a-ad9a-e0815f85cffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-169ebdc8-215b-4448-afa9-7913ffb8688c', 'volume_size': 1, 'snapshot_id': '3a210032-7f98-49ac-b3c9-e5f5453ecd6f'}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f319eb2c-656c-44f0-b90d-18936c0ad15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:47 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Volume volume-169ebdc8-215b-4448-afa9-7913ffb8688c (169ebdc8-215b-4448-afa9-7913ffb8688c): created successfully
Sep 10 14:01:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f319eb2c-656c-44f0-b90d-18936c0ad15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Flow 'volume_create_manager' (ab6d5e39-b962-40b7-9a0b-2ce372658e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:47 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-256de4bf-8dc0-4d1c-98ee-29970bbabdc1 tempest-SnapshotDependencyTests-101293509 None] Created volume successfully.
Sep 10 14:01:47 devstack quobyte-client[82845]: System call of process 96091 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:01:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f" returned: 0 in 0.646s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:48 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=99, name=volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:01:48 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "cinder-3a210032-7f98-49ac-b3c9-e5f5453ecd6f-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145 1G" returned: 0 in 0.444s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:48 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-3a210032-7f98-49ac-b3c9-e5f5453ecd6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.315s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:48 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:48 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "cinder-quobyte-be12c29c-2374-483d-8e3a-a008bdf76af9" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] CMD "qemu-img rebase -u -b volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145" returned: 0 in 0.330s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:01:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145" returned: 0 in 0.160s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:01:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-quobyte-be12c29c-2374-483d-8e3a-a008bdf76af9" acquired by "delete_snapshot" :: waited 0.385s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "cinder-quobyte-3a210032-7f98-49ac-b3c9-e5f5453ecd6f" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145" returned: 0 in 0.247s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-quobyte-3a210032-7f98-49ac-b3c9-e5f5453ecd6f" acquired by "_delete_snapshot" :: waited 0.260s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:49 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Deleting offline snapshot 3a210032-7f98-49ac-b3c9-e5f5453ecd6f of volume be12c29c-2374-483d-8e3a-a008bdf76af9 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:01:49 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] snapshot_file for this snap is: volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:01:49 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca29cb7-2bb9-4032-85d0-532f949c7a19]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.info" returned: 0 in 0.344s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:49 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:01:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.info" returned: 0 in 0.148s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.632s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:50 devstack quobyte-client[82845]: System call of process 96103 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:01:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f" returned: 0 in 0.725s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be12c29c-2374-483d-8e3a-a008bdf76af9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:01:50 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df61295-a32b-4883-825d-8175dfe7b3f3]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9" returned: 0 in 0.798s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:51 devstack quobyte-client[82845]: System call of process 96110 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:01:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f" returned: 0 in 0.544s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:51 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-62c964d1-e153-4938-a243-d8b0151b3d2d tempest-GroupSnapshotsV319Test-1433911491 None] group_snapshot 217bbc17-4a8a-4451-bea5-4a91801a7c6c: created successfully
Sep 10 14:01:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9.3a210032-7f98-49ac-b3c9-e5f5453ecd6f" returned: 0 in 0.471s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-quobyte-3a210032-7f98-49ac-b3c9-e5f5453ecd6f" released by "_delete_snapshot" :: held 2.805s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-quobyte-be12c29c-2374-483d-8e3a-a008bdf76af9" released by "delete_snapshot" :: held 3.109s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:52 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] group_snapshot 217bbc17-4a8a-4451-bea5-4a91801a7c6c: deleting
Sep 10 14:01:52 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] group_snapshot 217bbc17-4a8a-4451-bea5-4a91801a7c6c: deleting {{(pid=82823) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 14:01:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Acquiring lock "cinder-quobyte-c4a3c229-2856-4ced-be5b-6fb1745fa17f" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Lock "cinder-quobyte-c4a3c229-2856-4ced-be5b-6fb1745fa17f" acquired by "delete_snapshot" :: waited 0.118s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Acquiring lock "cinder-quobyte-ed635fa1-861d-46ce-a6d2-ffb163846145" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Lock "cinder-quobyte-ed635fa1-861d-46ce-a6d2-ffb163846145" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Deleting offline snapshot ed635fa1-861d-46ce-a6d2-ffb163846145 of volume c4a3c229-2856-4ced-be5b-6fb1745fa17f {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:01:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] snapshot_file for this snap is: volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:01:52 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Created reservations ['c0b664bb-4f79-4a7a-8a2d-222b3d97a723', '7dd657e3-a7be-47c7-a79c-a0e3da7c8709', '8e02c9d0-fd5a-42a6-a321-f4acbb810632', '06e03989-ba24-454f-88aa-2e206304d336'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:01:52 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[936de47a-5db0-42fe-aa92-1a4bf8edcf1b]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:53 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Delete snapshot completed successfully.
Sep 10 14:01:53 devstack quobyte-client[82845]: System call of process 96115 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:01:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-00e5ef6f-a70c-4fd1-9a8c-7a3cd299226b tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-3a210032-7f98-49ac-b3c9-e5f5453ecd6f-delete_snapshot" released by "delete_snapshot" :: held 4.534s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145" returned: 0 in 0.607s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:01:53 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[c746a052-40ee-45bb-8118-dc3e20a95db7]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "cinder-be12c29c-2374-483d-8e3a-a008bdf76af9-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f" returned: 0 in 0.647s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:54 devstack quobyte-client[82845]: System call of process 96121 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:01:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-be12c29c-2374-483d-8e3a-a008bdf76af9-delete_volume" acquired by "delete_volume" :: waited 0.261s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145" returned: 0 in 0.423s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:54 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "cinder-quobyte-be12c29c-2374-483d-8e3a-a008bdf76af9" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f.ed635fa1-861d-46ce-a6d2-ffb163846145" returned: 0 in 0.429s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-quobyte-be12c29c-2374-483d-8e3a-a008bdf76af9" acquired by "delete_volume" :: waited 0.111s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Lock "cinder-quobyte-ed635fa1-861d-46ce-a6d2-ffb163846145" released by "_delete_snapshot" :: held 2.375s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Lock "cinder-quobyte-c4a3c229-2856-4ced-be5b-6fb1745fa17f" released by "delete_snapshot" :: held 2.396s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:54 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0df2bfc-8e00-4b3a-acc3-17357a17fe2d]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:55 devstack cinder-volume[82823]: WARNING cinder.quota [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1970619473 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1970619473, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:01:55 devstack cinder-volume[82823]: WARNING cinder.quota [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1970619473 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1970619473, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:01:55 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] Created reservations ['39e0689d-56ba-4a61-a002-5e9e118eb4e8', '711a1174-f7a8-4fba-9c7b-993ffec03bb3', '8a4f0304-ad8f-47ba-af51-3b8bf31a773c', '763cde5b-330b-43d9-8ba6-593758088a71'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:01:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9" returned: 0 in 0.706s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-be12c29c-2374-483d-8e3a-a008bdf76af9" returned: 0 in 0.320s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:56 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-quobyte-be12c29c-2374-483d-8e3a-a008bdf76af9" released by "delete_volume" :: held 1.211s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:56 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f4663e2c-1ea1-448f-b9dd-ee898893fdae tempest-GroupSnapshotsV319Test-1433911491 None] group_snapshot 217bbc17-4a8a-4451-bea5-4a91801a7c6c: deleted successfully
Sep 10 14:01:56 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Created reservations ['587a5788-a367-4b73-91c6-5c8efa557a0c', '500bcab2-93c7-4119-935e-40cce40e500a', '3a3f1344-14b3-4da8-ae9f-db46c81c2920', '91484dac-cd0a-402c-b369-346d5ccd8555'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:01:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.089s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:56 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:01:56 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Deleted volume successfully.
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8e1bee66-95a2-49ce-b2a9-9f31317d5767 tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-be12c29c-2374-483d-8e3a-a008bdf76af9-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:57 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Flow 'volume_create_manager' (7b6f340d-61b4-465b-8c57-08de49756753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346fe2d1-59f3-4af3-9376-6be07987e9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:57 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "cinder-169ebdc8-215b-4448-afa9-7913ffb8688c-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346fe2d1-59f3-4af3-9376-6be07987e9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-654814808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c0a7d4bd74293a8f878483dd6c7a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:57Z,use_quota=True,user_id='fc071a8ed0fb49a0972a293ae26b3220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ba24c0-8eb3-403c-955f-bc7f0971d35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ba24c0-8eb3-403c-955f-bc7f0971d35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a13806-60ab-463c-a6d2-285b8168b3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a13806-60ab-463c-a6d2-285b8168b3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8', 'volume_name': 'volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018f8333-1b69-44c5-b963-3db7bbc04e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018f8333-1b69-44c5-b963-3db7bbc04e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1e2a31-3f83-4bfb-bfe0-fd195da7bab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:57 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Volume 27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8', 'volume_size': 1}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-654814808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c0a7d4bd74293a8f878483dd6c7a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:01:57Z,use_quota=True,user_id='fc071a8ed0fb49a0972a293ae26b3220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Creating volume 27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:01:57 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:57 devstack quobyte-client[82845]: System call of process 96130 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:01:57 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=101, name=volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Acquiring lock "cinder-quobyte-c4a3c229-2856-4ced-be5b-6fb1745fa17f" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-169ebdc8-215b-4448-afa9-7913ffb8688c-delete_volume" acquired by "delete_volume" :: waited 0.402s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Lock "cinder-quobyte-c4a3c229-2856-4ced-be5b-6fb1745fa17f" acquired by "delete_volume" :: waited 0.288s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 1073741824" returned: 0 in 0.518s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:58 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cbc8ac-d536-42ba-9d7f-87525f7e61a0]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:58 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:01:58 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "cinder-quobyte-169ebdc8-215b-4448-afa9-7913ffb8688c" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:01:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8" returned: 0 in 0.594s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] <== create_volume: return (1139ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:01:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:01:58 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-quobyte-169ebdc8-215b-4448-afa9-7913ffb8688c" acquired by "delete_volume" :: waited 0.213s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:01:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1e2a31-3f83-4bfb-bfe0-fd195da7bab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfef21f-a4bf-4b2d-94eb-1bc5afc0ba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:01:58 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f6f4db-2bd8-48c9-aaa1-784f2fe3e1ec]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:01:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169ebdc8-215b-4448-afa9-7913ffb8688c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:58 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Volume volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 (27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8): created successfully
Sep 10 14:01:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfef21f-a4bf-4b2d-94eb-1bc5afc0ba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:01:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Flow 'volume_create_manager' (7b6f340d-61b4-465b-8c57-08de49756753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:01:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f" returned: 0 in 0.916s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:59 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-26bdeb9c-660f-4986-87eb-8095acfedfd7 tempest-SnapshotMetadataTestJSON-963054468 None] Created volume successfully.
Sep 10 14:01:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c4a3c229-2856-4ced-be5b-6fb1745fa17f" returned: 0 in 0.296s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169ebdc8-215b-4448-afa9-7913ffb8688c" returned: 0 in 0.761s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169ebdc8-215b-4448-afa9-7913ffb8688c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:01:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Lock "cinder-quobyte-c4a3c229-2856-4ced-be5b-6fb1745fa17f" released by "delete_volume" :: held 1.822s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:01:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-169ebdc8-215b-4448-afa9-7913ffb8688c" returned: 0 in 0.471s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:01:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-quobyte-169ebdc8-215b-4448-afa9-7913ffb8688c" released by "delete_volume" :: held 1.370s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:02:00 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Created reservations ['91e19dc4-7eb1-4570-b91d-8adbd6020306', 'e468b308-84a7-4dae-8bfe-2e050abb425c', '49d3b674-127e-4f98-98fc-8769a510c59e', '02eb98d1-c9c0-4499-bca5-86f0d9c78e95'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:02:00 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Created reservations ['7874e294-4df9-4324-a2bc-35680d7a8543'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:02:00 devstack cinder-volume[82823]: WARNING cinder.quota [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1970619473 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1970619473, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:02:00 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] Creating offline snapshot a973d7a0-09c3-4056-b574-494b297af279 of volume 27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:02:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:02:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:02:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:00 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[3298d4fd-7116-4393-87b7-726a5fbf6be1]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:00 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Created reservations ['2a89954d-0ada-4f5d-abb6-4f416038c5d2', '50a2bd01-e5bf-4666-aa0e-cfe116169733', '8e44b675-8f6f-40fd-bc79-07a5b1c46484', '107f001c-01eb-4035-986a-f7a85dca0b75'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:02:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.668s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:01 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:02:01 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Deleted volume successfully.
Sep 10 14:02:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-70cf15eb-e065-4e7e-8cf7-01a01688e70b tempest-SnapshotDependencyTests-101293509 None] Lock "cinder-169ebdc8-215b-4448-afa9-7913ffb8688c-delete_volume" released by "delete_volume" :: held 3.680s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:02:01 devstack quobyte-client[82845]: System call of process 96144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:02:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8" returned: 0 in 0.913s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:01 devstack quobyte-client[82845]: System call of process 96147 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:02:01 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=102, name=volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:02:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:02:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:02:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279 1G" returned: 0 in 0.838s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): qemu-img rebase -u -b volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.274s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:02 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:02:02 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-7fbd2995-3be5-4102-a8de-b7fa5dff7878 tempest-GroupSnapshotsV319Test-1433911491 None] Delete group completed successfully.
Sep 10 14:02:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "qemu-img rebase -u -b volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279" returned: 0 in 0.273s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:02:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279" returned: 0 in 0.246s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:02:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279" returned: 0 in 0.143s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.info" returned: 0 in 0.198s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:02:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.info" returned: 0 in 0.134s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.303s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:04 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-aae24d70-d8cc-4196-8498-81f744b37992 tempest-SnapshotMetadataTestJSON-963054468 None] Create snapshot completed successfully
Sep 10 14:02:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Acquiring lock "cinder-a973d7a0-09c3-4056-b574-494b297af279-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:02:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "cinder-a973d7a0-09c3-4056-b574-494b297af279-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:02:06 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Acquiring lock "cinder-quobyte-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:02:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "cinder-quobyte-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:02:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Acquiring lock "cinder-quobyte-a973d7a0-09c3-4056-b574-494b297af279" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:02:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "cinder-quobyte-a973d7a0-09c3-4056-b574-494b297af279" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:02:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Deleting offline snapshot a973d7a0-09c3-4056-b574-494b297af279 of volume 27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:02:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] snapshot_file for this snap is: volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:02:06 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc78da83-488b-407e-8fb4-d83cb1d0c9e7]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279" returned: 0 in 0.614s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:02:07 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a13a138-df02-47ad-93a8-f3dba5958902]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8" returned: 0 in 0.632s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279" returned: 0 in 0.537s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8.a973d7a0-09c3-4056-b574-494b297af279" returned: 0 in 0.189s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:08 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "cinder-quobyte-a973d7a0-09c3-4056-b574-494b297af279" released by "_delete_snapshot" :: held 2.514s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:02:08 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "cinder-quobyte-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8" released by "delete_snapshot" :: held 2.550s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:02:09 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Created reservations ['2e357fd8-c13e-4781-a993-666083f1631f', '59b6c821-97f3-48ae-9455-41953e601bc2', '11091f5f-750e-4dfa-b4c1-3260cf424580', 'e62515c7-1341-4b82-92a3-595f29674a49'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:02:09 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Delete snapshot completed successfully.
Sep 10 14:02:09 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-43702fad-17cd-44b2-b0f7-056741ebb099 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "cinder-a973d7a0-09c3-4056-b574-494b297af279-delete_snapshot" released by "delete_snapshot" :: held 3.101s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:02:09 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Acquiring lock "cinder-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:02:09 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "cinder-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:02:09 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:09 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Acquiring lock "cinder-quobyte-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:02:09 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "cinder-quobyte-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8" acquired by "delete_volume" :: waited 0.025s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:02:09 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e37451-d90b-4814-823e-900ba08de92f]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8" returned: 0 in 0.565s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8" returned: 0 in 0.159s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "cinder-quobyte-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8" released by "delete_volume" :: held 0.944s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:02:11 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Created reservations ['4224ba7f-2017-4651-9ae7-d8355f7c079f', '57ba5d8e-3d79-450c-9a98-52031055d212', 'b7cafa9b-660a-4a26-ae07-b85b0e9d2276', '149f37dc-da33-4dfd-85d2-81f4d09f676a'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:02:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.036s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:02:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:02:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.180s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:12 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:02:12 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Deleted volume successfully.
Sep 10 14:02:12 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-190ec1cc-a110-4cbf-9727-1aee5925e091 tempest-SnapshotMetadataTestJSON-963054468 None] Lock "cinder-27f4f0dd-8838-43f3-9bd6-4c18b19aa1e8-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:02:21 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:INSERT=13,cinder:UPDATE=83,cinder:SELECT=62,cinder:DELETE=4 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:02:22 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=54,cinder:UPDATE=68,cinder:DELETE=5,cinder:INSERT=24 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:02:23 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Flow 'volume_create_manager' (7ef45b19-87db-4314-80c2-e8b07ba5823d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbc9d6e-4af1-478e-8c08-4bc07eff05ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbc9d6e-4af1-478e-8c08-4bc07eff05ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1784686726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace1a62b-56b3-4f65-92d3-f6080bbee09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0badfb70ef1406886325c04f1639076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:02:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:02:23Z,use_quota=True,user_id='08a4fda3aa9246e18f186ea3371585c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f39ab2c-e805-4722-89f4-5f94cb519c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f39ab2c-e805-4722-89f4-5f94cb519c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3c0e3d-d185-4fb3-afc7-d9aac455c3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3c0e3d-d185-4fb3-afc7-d9aac455c3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ace1a62b-56b3-4f65-92d3-f6080bbee09b', 'volume_name': 'volume-ace1a62b-56b3-4f65-92d3-f6080bbee09b', 'volume_size': 2}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e768f881-20b7-477b-8f6c-c02eaf37f0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e768f881-20b7-477b-8f6c-c02eaf37f0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495d3884-5b48-4c4f-a2bd-2374d7824b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:23 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Volume ace1a62b-56b3-4f65-92d3-f6080bbee09b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ace1a62b-56b3-4f65-92d3-f6080bbee09b', 'volume_size': 2}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1784686726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace1a62b-56b3-4f65-92d3-f6080bbee09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0badfb70ef1406886325c04f1639076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:02:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:02:23Z,use_quota=True,user_id='08a4fda3aa9246e18f186ea3371585c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Creating volume ace1a62b-56b3-4f65-92d3-f6080bbee09b {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:02:23 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:02:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ace1a62b-56b3-4f65-92d3-f6080bbee09b 2147483648 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:24 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=104, name=volume-ace1a62b-56b3-4f65-92d3-f6080bbee09b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:02:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ace1a62b-56b3-4f65-92d3-f6080bbee09b 2147483648" returned: 0 in 0.663s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ace1a62b-56b3-4f65-92d3-f6080bbee09b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ace1a62b-56b3-4f65-92d3-f6080bbee09b" returned: 0 in 0.162s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] <== create_volume: return (931ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:02:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495d3884-5b48-4c4f-a2bd-2374d7824b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ace1a62b-56b3-4f65-92d3-f6080bbee09b', 'volume_size': 2}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf32c997-8fab-4e8c-93b1-94c6db8c58fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:25 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Volume volume-ace1a62b-56b3-4f65-92d3-f6080bbee09b (ace1a62b-56b3-4f65-92d3-f6080bbee09b): created successfully
Sep 10 14:02:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf32c997-8fab-4e8c-93b1-94c6db8c58fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Flow 'volume_create_manager' (7ef45b19-87db-4314-80c2-e8b07ba5823d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:02:25 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-d4e893d9-4dde-4f41-97e1-12f22cdd66a2 tempest-VolumesCloneNegativeTest-322308890 None] Created volume successfully.
Sep 10 14:02:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Acquiring lock "cinder-ace1a62b-56b3-4f65-92d3-f6080bbee09b-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:02:26 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Lock "cinder-ace1a62b-56b3-4f65-92d3-f6080bbee09b-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:02:26 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:26 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Acquiring lock "cinder-quobyte-ace1a62b-56b3-4f65-92d3-f6080bbee09b" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:02:26 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Lock "cinder-quobyte-ace1a62b-56b3-4f65-92d3-f6080bbee09b" acquired by "delete_volume" :: waited 0.015s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:02:26 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd50b76-c121-4d43-a1ef-241523a44f14]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ace1a62b-56b3-4f65-92d3-f6080bbee09b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ace1a62b-56b3-4f65-92d3-f6080bbee09b" returned: 0 in 0.597s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ace1a62b-56b3-4f65-92d3-f6080bbee09b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ace1a62b-56b3-4f65-92d3-f6080bbee09b" returned: 0 in 0.174s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Lock "cinder-quobyte-ace1a62b-56b3-4f65-92d3-f6080bbee09b" released by "delete_volume" :: held 1.053s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:02:27 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Created reservations ['11ac5e17-df89-4a55-a0e6-5925c373e79a', 'fdf082d0-b0df-4d6a-a881-bff2b73afb3a', '766cc8e6-7065-4723-9735-9abd5f4395ff', 'e6d8b5cd-2987-49e2-99de-8d649e59e0ba'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:02:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:02:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:02:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.103s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:27 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:02:28 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Deleted volume successfully.
Sep 10 14:02:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b3fcf233-3d7e-4100-b802-5a8b3559f948 tempest-VolumesCloneNegativeTest-322308890 None] Lock "cinder-ace1a62b-56b3-4f65-92d3-f6080bbee09b-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:02:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 14:02:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:02:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:02:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:30 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a17261e9-b48e-4a57-9c55-1fbf35e66f09 tempest-GroupsTest-1331452265 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:30 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a17261e9-b48e-4a57-9c55-1fbf35e66f09 tempest-GroupsTest-1331452265 None] Group tempest-Group1-899997075: creating
Sep 10 14:02:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.501s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:02:30 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a17261e9-b48e-4a57-9c55-1fbf35e66f09 tempest-GroupsTest-1331452265 None] Group tempest-Group1-899997075: created successfully
Sep 10 14:02:30 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a17261e9-b48e-4a57-9c55-1fbf35e66f09 tempest-GroupsTest-1331452265 None] Create group completed successfully.
Sep 10 14:02:31 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a2800522-5bbe-40b7-920b-e3fbfdd37053 tempest-GroupsTest-1331452265 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:31 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a2800522-5bbe-40b7-920b-e3fbfdd37053 tempest-GroupsTest-1331452265 None] Group tempest-Group2-1350790856: creating
Sep 10 14:02:31 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a2800522-5bbe-40b7-920b-e3fbfdd37053 tempest-GroupsTest-1331452265 None] Group tempest-Group2-1350790856: created successfully
Sep 10 14:02:31 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a2800522-5bbe-40b7-920b-e3fbfdd37053 tempest-GroupsTest-1331452265 None] Create group completed successfully.
Sep 10 14:02:32 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:32 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:02:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Flow 'volume_create_manager' (b49ecc86-650d-4468-a98c-a8f40c0d6b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:02:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf86eb0-8edb-4368-878a-77ed99d54fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf86eb0-8edb-4368-878a-77ed99d54fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-587480827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ad938f-f520-4f85-ac08-c00652b6052b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1977d1ab85e0481eb9ebc298bfa55cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:02:32Z,use_quota=True,user_id='b1a92214a1d64db0b362dc5c10b223ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e52123-21a1-43f4-9428-6d4f4873964c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e52123-21a1-43f4-9428-6d4f4873964c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f47c97b-823e-442b-960d-720f8636b699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f47c97b-823e-442b-960d-720f8636b699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '13ad938f-f520-4f85-ac08-c00652b6052b', 'volume_name': 'volume-13ad938f-f520-4f85-ac08-c00652b6052b', 'volume_size': 1, 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02b5bb39d7434620bf21786ff3aad29c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'created_at': datetime.datetime(2025, 9, 10, 11, 23, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 23, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f8481a-df2c-4f8b-8548-87d289ce329e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b5b1a9b0>}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64bf7f8-5f2d-4fd6-8257-7360ef131249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64bf7f8-5f2d-4fd6-8257-7360ef131249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1eb78f-bb93-4593-a40c-fb9b7e3717e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:32 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Volume 13ad938f-f520-4f85-ac08-c00652b6052b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-13ad938f-f520-4f85-ac08-c00652b6052b', 'volume_size': 1, 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02b5bb39d7434620bf21786ff3aad29c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'created_at': datetime.datetime(2025, 9, 10, 11, 23, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 23, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f8481a-df2c-4f8b-8548-87d289ce329e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b5b1a9b0>}
Sep 10 14:02:32 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Cloning 13ad938f-f520-4f85-ac08-c00652b6052b from image b4f8481a-df2c-4f8b-8548-87d289ce329e  at location (None, None). {{(pid=82823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 14:02:33 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Flow 'volume_create_manager' (10e80d82-da87-4e4f-8dde-73c9d981cd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fffb89e6-b393-45b5-8a12-d7e6ee959746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fffb89e6-b393-45b5-8a12-d7e6ee959746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-365537448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=10f73d91-5388-4b60-9556-3d295457157d,host='devstack@QuobyteHD#QuobyteHD',id=6e1cbfd9-8a08-4071-9ffd-9c731987944f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80e03bc09de4952a7d7018098c162b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:02:33Z,use_quota=True,user_id='fc314503724f4c0b8d65c5ebdf864ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab030cbb-b4e1-4b36-a5aa-8f22f0e628a3),volume_type_id=ab030cbb-b4e1-4b36-a5aa-8f22f0e628a3)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f2118b-255c-4c2c-ada9-db218c0089ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f2118b-255c-4c2c-ada9-db218c0089ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16bc790-b9a3-44d4-9b4a-67bfff888933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16bc790-b9a3-44d4-9b4a-67bfff888933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e1cbfd9-8a08-4071-9ffd-9c731987944f', 'volume_name': 'volume-6e1cbfd9-8a08-4071-9ffd-9c731987944f', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a122e3-dc33-44ba-ae67-f881e5f1cad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a122e3-dc33-44ba-ae67-f881e5f1cad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c6496c-6b6d-4b70-ad71-7e7a4912b4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:33 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Volume 6e1cbfd9-8a08-4071-9ffd-9c731987944f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e1cbfd9-8a08-4071-9ffd-9c731987944f', 'volume_size': 1}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=10f73d91-5388-4b60-9556-3d295457157d,created_at=2025-09-10T12:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-365537448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=10f73d91-5388-4b60-9556-3d295457157d,host='devstack@QuobyteHD#QuobyteHD',id=6e1cbfd9-8a08-4071-9ffd-9c731987944f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80e03bc09de4952a7d7018098c162b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:02:33Z,use_quota=True,user_id='fc314503724f4c0b8d65c5ebdf864ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab030cbb-b4e1-4b36-a5aa-8f22f0e628a3),volume_type_id=ab030cbb-b4e1-4b36-a5aa-8f22f0e628a3)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Creating volume 6e1cbfd9-8a08-4071-9ffd-9c731987944f {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:02:33 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6e1cbfd9-8a08-4071-9ffd-9c731987944f 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:33 devstack quobyte-client[82845]: System call of process 96233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:02:33 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=105, name=volume-6e1cbfd9-8a08-4071-9ffd-9c731987944f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6e1cbfd9-8a08-4071-9ffd-9c731987944f 1073741824" returned: 0 in 0.360s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6e1cbfd9-8a08-4071-9ffd-9c731987944f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_fhfcnhj4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 14:02:33 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Image download 20.69 MB at 20.69 MB/s
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6e1cbfd9-8a08-4071-9ffd-9c731987944f" returned: 0 in 0.230s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] <== create_volume: return (626ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:02:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.634s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c6496c-6b6d-4b70-ad71-7e7a4912b4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e1cbfd9-8a08-4071-9ffd-9c731987944f', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e8ce1f-ed31-4fdd-8c63-80b1a076033f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:34 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a842c40-b9ff-4248-b0a3-315ae542db1d]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_fhfcnhj4devstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:34 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Volume volume-6e1cbfd9-8a08-4071-9ffd-9c731987944f (6e1cbfd9-8a08-4071-9ffd-9c731987944f): created successfully
Sep 10 14:02:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e8ce1f-ed31-4fdd-8c63-80b1a076033f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Flow 'volume_create_manager' (10e80d82-da87-4e4f-8dde-73c9d981cd7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:02:34 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-e7afce11-758e-4bb4-af2e-c7241379105c tempest-GroupsTest-1331452265 None] Created volume successfully.
Sep 10 14:02:34 devstack sudo[96237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_fhfcnhj4devstack@QuobyteHD
Sep 10 14:02:34 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 14:02:36 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:36 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Acquiring lock "cinder-quobyte-6e1cbfd9-8a08-4071-9ffd-9c731987944f" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:02:36 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Lock "cinder-quobyte-6e1cbfd9-8a08-4071-9ffd-9c731987944f" acquired by "delete_volume" :: waited 0.107s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:02:36 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[da195d8a-0001-4e0f-9cd0-92f155bc3f2b]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6e1cbfd9-8a08-4071-9ffd-9c731987944f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:36 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root
Sep 10 14:02:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_fhfcnhj4devstack@QuobyteHD" returned: 0 in 2.363s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:36 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Temporary image b4f8481a-df2c-4f8b-8548-87d289ce329e is fetched for user b1a92214a1d64db0b362dc5c10b223ed. {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 14:02:36 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d0e424-62b9-4072-9e13-638f80ac496b]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_fhfcnhj4devstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:36 devstack quobyte-client[82845]: System call of process 96242 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:02:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6e1cbfd9-8a08-4071-9ffd-9c731987944f" returned: 0 in 0.698s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6e1cbfd9-8a08-4071-9ffd-9c731987944f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6e1cbfd9-8a08-4071-9ffd-9c731987944f" returned: 0 in 0.131s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Lock "cinder-quobyte-6e1cbfd9-8a08-4071-9ffd-9c731987944f" released by "delete_volume" :: held 1.008s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:02:37 devstack sudo[96243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_fhfcnhj4devstack@QuobyteHD
Sep 10 14:02:37 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 14:02:37 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Created reservations ['c2ab3791-1006-4e0f-b84a-5f4454f2a5c0'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:02:37 devstack cinder-volume[82823]: WARNING cinder.quota [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1900079112 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1900079112, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:02:37 devstack cinder-volume[82823]: WARNING cinder.quota [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1900079112 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1900079112, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:02:37 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Created reservations ['93cbc7de-2140-4ab7-b006-ece873a0e431', 'fbc80bd4-6253-4129-93fd-f9495f76c15a', 'dfbda67f-26b5-4899-813e-e61b6c4d66fd', '63acda23-9e67-4ac3-bdca-ea9fc3eeeff3'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:02:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:02:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:02:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.106s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:38 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:02:38 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f8ec6bcf-61bb-4bcd-8ee5-be5ea9a8df8b tempest-GroupsTest-1331452265 None] Delete group completed successfully.
Sep 10 14:02:38 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b04fe0bb-1467-4cc7-96d0-17dea0e6c351 tempest-GroupsTest-1331452265 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:38 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-b04fe0bb-1467-4cc7-96d0-17dea0e6c351 tempest-GroupsTest-1331452265 None] Created reservations ['fa2db82f-1ab4-4881-bdaa-43d8c084e50a'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:02:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b04fe0bb-1467-4cc7-96d0-17dea0e6c351 tempest-GroupsTest-1331452265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b04fe0bb-1467-4cc7-96d0-17dea0e6c351 tempest-GroupsTest-1331452265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b04fe0bb-1467-4cc7-96d0-17dea0e6c351 tempest-GroupsTest-1331452265 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:02:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b04fe0bb-1467-4cc7-96d0-17dea0e6c351 tempest-GroupsTest-1331452265 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:02:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b04fe0bb-1467-4cc7-96d0-17dea0e6c351 tempest-GroupsTest-1331452265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b04fe0bb-1467-4cc7-96d0-17dea0e6c351 tempest-GroupsTest-1331452265 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b04fe0bb-1467-4cc7-96d0-17dea0e6c351 tempest-GroupsTest-1331452265 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.270s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:39 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-b04fe0bb-1467-4cc7-96d0-17dea0e6c351 tempest-GroupsTest-1331452265 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:02:39 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b04fe0bb-1467-4cc7-96d0-17dea0e6c351 tempest-GroupsTest-1331452265 None] Delete group completed successfully.
Sep 10 14:02:39 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root
Sep 10 14:02:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_fhfcnhj4devstack@QuobyteHD" returned: 0 in 2.738s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-587480827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ad938f-f520-4f85-ac08-c00652b6052b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1977d1ab85e0481eb9ebc298bfa55cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:02:32Z,use_quota=True,user_id='b1a92214a1d64db0b362dc5c10b223ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:02:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Creating volume 13ad938f-f520-4f85-ac08-c00652b6052b {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:02:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:02:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:02:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:02:39 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:02:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:39 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=106, name=volume-13ad938f-f520-4f85-ac08-c00652b6052b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:02:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b 1073741824" returned: 0 in 0.468s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b" returned: 0 in 0.104s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] <== create_volume: return (675ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:02:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:40 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-20e63efa-1557-4f7f-b1be-bb180e3c062d tempest-GroupsTest-1331452265 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:40 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-20e63efa-1557-4f7f-b1be-bb180e3c062d tempest-GroupsTest-1331452265 None] Group tempest-GroupsTest-Group-1233574182: creating
Sep 10 14:02:40 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Attempting download of b4f8481a-df2c-4f8b-8548-87d289ce329e ((None, None)) to volume 13ad938f-f520-4f85-ac08-c00652b6052b. {{(pid=82823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 14:02:40 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-20e63efa-1557-4f7f-b1be-bb180e3c062d tempest-GroupsTest-1331452265 None] Group tempest-GroupsTest-Group-1233574182: created successfully
Sep 10 14:02:40 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-20e63efa-1557-4f7f-b1be-bb180e3c062d tempest-GroupsTest-1331452265 None] Create group completed successfully.
Sep 10 14:02:40 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b47e669-229a-41a6-9ad1-b6c476856953]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_ucucy7on {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_ucucy7on" returned: 0 in 0.365s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_ucucy7on {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_ucucy7on" returned: 1 in 0.412s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_ucucy7on' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:02:41 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f73b060-05ed-4121-b8e0-d380f15ae7c2]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_fhfcnhj4devstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_fhfcnhj4devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:42 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] b4f8481a-df2c-4f8b-8548-87d289ce329e was qcow2, converting to raw {{(pid=82823) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 14:02:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_fhfcnhj4devstack@QuobyteHD /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:42 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=106, name=volume-13ad938f-f520-4f85-ac08-c00652b6052b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:02:43 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Flow 'volume_create_manager' (8b359d66-d008-4002-b140-9f71150118bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8f48e2-79df-4f2c-b77b-7047abb88401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8f48e2-79df-4f2c-b77b-7047abb88401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-252063931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb370434-b406-4dde-89db-012343459740,host='devstack@QuobyteHD#QuobyteHD',id=eed52fb4-7f1f-4380-9b9d-6d6f850b4be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80e03bc09de4952a7d7018098c162b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:02:43Z,use_quota=True,user_id='fc314503724f4c0b8d65c5ebdf864ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ff2bc11-5507-452c-953e-91c7a3281626),volume_type_id=0ff2bc11-5507-452c-953e-91c7a3281626)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c494b2f-4077-40fd-b6ec-39d4abd403a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c494b2f-4077-40fd-b6ec-39d4abd403a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded68dd6-1487-4d17-90cb-a334e5289be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded68dd6-1487-4d17-90cb-a334e5289be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed52fb4-7f1f-4380-9b9d-6d6f850b4be5', 'volume_name': 'volume-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096f6ff8-14ed-4ced-99fb-b50e4ad23116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096f6ff8-14ed-4ced-99fb-b50e4ad23116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a449ac4-56a8-4e13-8607-234acc8d25b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:43 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Volume eed52fb4-7f1f-4380-9b9d-6d6f850b4be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5', 'volume_size': 1}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=eb370434-b406-4dde-89db-012343459740,created_at=2025-09-10T12:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-252063931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb370434-b406-4dde-89db-012343459740,host='devstack@QuobyteHD#QuobyteHD',id=eed52fb4-7f1f-4380-9b9d-6d6f850b4be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80e03bc09de4952a7d7018098c162b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:02:43Z,use_quota=True,user_id='fc314503724f4c0b8d65c5ebdf864ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ff2bc11-5507-452c-953e-91c7a3281626),volume_type_id=0ff2bc11-5507-452c-953e-91c7a3281626)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Creating volume eed52fb4-7f1f-4380-9b9d-6d6f850b4be5 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:02:43 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:43 devstack quobyte-client[82845]: System call of process 96275 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:02:43 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=107, name=volume-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_fhfcnhj4devstack@QuobyteHD /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b" returned: 0 in 1.291s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_fhfcnhj4devstack@QuobyteHD, size 112.00 MB, duration 1.32 sec, destination /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b {{(pid=82823) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 14:02:43 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Converted 112.00 MB image at 84.81 MB/s
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:43 devstack quobyte-client[82845]: System call of process 96278 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5 1073741824" returned: 0 in 0.376s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b 1G" returned: 0 in 0.353s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5" returned: 0 in 0.136s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] <== create_volume: return (574ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.587s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c77311a-6520-4437-9056-c6a9a39364c0]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a449ac4-56a8-4e13-8607-234acc8d25b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7f6281-cc67-402b-af0d-5504c6acda06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:44 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Volume volume-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5 (eed52fb4-7f1f-4380-9b9d-6d6f850b4be5): created successfully
Sep 10 14:02:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7f6281-cc67-402b-af0d-5504c6acda06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Flow 'volume_create_manager' (8b359d66-d008-4002-b140-9f71150118bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:02:44 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-d08aa7a1-b83b-4f98-af19-6779b9c3f165 tempest-GroupsTest-1331452265 None] Created volume successfully.
Sep 10 14:02:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b" returned: 0 in 0.500s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:44 devstack quobyte-client[82845]: System call of process 96284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:02:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b" returned: 1 in 0.420s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:02:44 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Downloaded image b4f8481a-df2c-4f8b-8548-87d289ce329e ((None, None)) to volume 13ad938f-f520-4f85-ac08-c00652b6052b successfully. {{(pid=82823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 14:02:44 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Temporary image b4f8481a-df2c-4f8b-8548-87d289ce329e for user b1a92214a1d64db0b362dc5c10b223ed is deleted. {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 14:02:44 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Marking volume 13ad938f-f520-4f85-ac08-c00652b6052b as bootable. {{(pid=82823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Copying metadata from image b4f8481a-df2c-4f8b-8548-87d289ce329e to 13ad938f-f520-4f85-ac08-c00652b6052b. {{(pid=82823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Creating volume glance metadata for volume 13ad938f-f520-4f85-ac08-c00652b6052b backed by image b4f8481a-df2c-4f8b-8548-87d289ce329e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1eb78f-bb93-4593-a40c-fb9b7e3717e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13ad938f-f520-4f85-ac08-c00652b6052b', 'volume_size': 1, 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02b5bb39d7434620bf21786ff3aad29c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'created_at': datetime.datetime(2025, 9, 10, 11, 23, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 23, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f8481a-df2c-4f8b-8548-87d289ce329e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b5b1a9b0>}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c44cb0-ce41-426a-8c5b-a431fd0d2edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:45 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Volume volume-13ad938f-f520-4f85-ac08-c00652b6052b (13ad938f-f520-4f85-ac08-c00652b6052b): created successfully
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c44cb0-ce41-426a-8c5b-a431fd0d2edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Flow 'volume_create_manager' (b49ecc86-650d-4468-a98c-a8f40c0d6b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:02:45 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-ac44b614-e996-4349-ac0f-d2efafc90aa4 tempest-VolumesExtendTest-1857084434 None] Created volume successfully.
Sep 10 14:02:45 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Flow 'volume_create_manager' (7462279f-f948-4955-8393-7bc213d51f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533eda10-5572-44dd-8b15-b37f2b8910bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533eda10-5572-44dd-8b15-b37f2b8910bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1678676237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb370434-b406-4dde-89db-012343459740,host='devstack@QuobyteHD#QuobyteHD',id=bd63ba5d-11cb-4798-a20b-04f845aca7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80e03bc09de4952a7d7018098c162b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:02:46Z,use_quota=True,user_id='fc314503724f4c0b8d65c5ebdf864ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ff2bc11-5507-452c-953e-91c7a3281626),volume_type_id=0ff2bc11-5507-452c-953e-91c7a3281626)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea93afb9-6968-4048-980c-70ca55d01422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea93afb9-6968-4048-980c-70ca55d01422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c50e09-93f2-4fc1-8a63-63eefbfa0c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c50e09-93f2-4fc1-8a63-63eefbfa0c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd63ba5d-11cb-4798-a20b-04f845aca7e2', 'volume_name': 'volume-bd63ba5d-11cb-4798-a20b-04f845aca7e2', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fe2187-7a1d-4080-b915-b2e552a79bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fe2187-7a1d-4080-b915-b2e552a79bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d10903c-1765-41a8-9f76-ac2b615bd460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:45 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Volume bd63ba5d-11cb-4798-a20b-04f845aca7e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd63ba5d-11cb-4798-a20b-04f845aca7e2', 'volume_size': 1}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=eb370434-b406-4dde-89db-012343459740,created_at=2025-09-10T12:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1678676237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb370434-b406-4dde-89db-012343459740,host='devstack@QuobyteHD#QuobyteHD',id=bd63ba5d-11cb-4798-a20b-04f845aca7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e80e03bc09de4952a7d7018098c162b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:02:46Z,use_quota=True,user_id='fc314503724f4c0b8d65c5ebdf864ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ff2bc11-5507-452c-953e-91c7a3281626),volume_type_id=0ff2bc11-5507-452c-953e-91c7a3281626)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Creating volume bd63ba5d-11cb-4798-a20b-04f845aca7e2 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:02:46 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bd63ba5d-11cb-4798-a20b-04f845aca7e2 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:46 devstack quobyte-client[82845]: System call of process 96287 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:02:46 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=108, name=volume-bd63ba5d-11cb-4798-a20b-04f845aca7e2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:02:46 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-1600583c-05f1-48d2-a292-36b45631fe37 tempest-VolumesExtendTest-1857084434 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1600583c-05f1-48d2-a292-36b45631fe37 tempest-VolumesExtendTest-1857084434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bd63ba5d-11cb-4798-a20b-04f845aca7e2 1073741824" returned: 0 in 0.538s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bd63ba5d-11cb-4798-a20b-04f845aca7e2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bd63ba5d-11cb-4798-a20b-04f845aca7e2" returned: 0 in 0.171s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] <== create_volume: return (773ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1600583c-05f1-48d2-a292-36b45631fe37 tempest-VolumesExtendTest-1857084434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.467s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d10903c-1765-41a8-9f76-ac2b615bd460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd63ba5d-11cb-4798-a20b-04f845aca7e2', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9e5464-09f0-46f0-a3ee-8f0be5c059c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:47 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdec22eb-7720-4c3e-b7a9-f9a8b7cf2e34]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1600583c-05f1-48d2-a292-36b45631fe37 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:47 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Volume volume-bd63ba5d-11cb-4798-a20b-04f845aca7e2 (bd63ba5d-11cb-4798-a20b-04f845aca7e2): created successfully
Sep 10 14:02:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9e5464-09f0-46f0-a3ee-8f0be5c059c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:47 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Flow 'volume_create_manager' (7462279f-f948-4955-8393-7bc213d51f04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:02:47 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a0b59de4-87a6-41dd-9a3c-4ce3b3dc800c tempest-GroupsTest-1331452265 None] Created volume successfully.
Sep 10 14:02:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1600583c-05f1-48d2-a292-36b45631fe37 tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b" returned: 0 in 0.550s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1600583c-05f1-48d2-a292-36b45631fe37 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:48 devstack quobyte-client[82845]: System call of process 96293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:02:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1600583c-05f1-48d2-a292-36b45631fe37 tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b" returned: 1 in 0.614s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1600583c-05f1-48d2-a292-36b45631fe37 tempest-VolumesExtendTest-1857084434 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:02:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1600583c-05f1-48d2-a292-36b45631fe37 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b 2G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:48 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-449b7373-5a29-4c8b-ba1f-a11038592864 tempest-GroupsTest-1331452265 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1600583c-05f1-48d2-a292-36b45631fe37 tempest-VolumesExtendTest-1857084434 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b 2G" returned: 0 in 0.365s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1600583c-05f1-48d2-a292-36b45631fe37 tempest-VolumesExtendTest-1857084434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.704s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:48 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-449b7373-5a29-4c8b-ba1f-a11038592864 tempest-GroupsTest-1331452265 None] Update group completed successfully.
Sep 10 14:02:48 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-1600583c-05f1-48d2-a292-36b45631fe37 tempest-VolumesExtendTest-1857084434 None] Extend volume completed successfully.
Sep 10 14:02:49 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-638489c7-dee8-4804-9d6d-f3f3f6219f13 tempest-GroupsTest-1331452265 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:49 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-638489c7-dee8-4804-9d6d-f3f3f6219f13 tempest-GroupsTest-1331452265 None] Update group completed successfully.
Sep 10 14:02:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Acquiring lock "cinder-13ad938f-f520-4f85-ac08-c00652b6052b-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:02:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Lock "cinder-13ad938f-f520-4f85-ac08-c00652b6052b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:02:49 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Acquiring lock "cinder-quobyte-13ad938f-f520-4f85-ac08-c00652b6052b" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:02:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Lock "cinder-quobyte-13ad938f-f520-4f85-ac08-c00652b6052b" acquired by "delete_volume" :: waited 0.023s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:02:50 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed82adb5-0c0a-4fbd-a04a-a6e0b25a4d1d]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b" returned: 0 in 0.425s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b" returned: 1 in 0.602s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:02:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13ad938f-f520-4f85-ac08-c00652b6052b" returned: 0 in 0.235s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:51 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:51 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Acquiring lock "cinder-quobyte-bd63ba5d-11cb-4798-a20b-04f845aca7e2" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:02:51 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Lock "cinder-quobyte-13ad938f-f520-4f85-ac08-c00652b6052b" released by "delete_volume" :: held 1.529s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:02:51 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Lock "cinder-quobyte-bd63ba5d-11cb-4798-a20b-04f845aca7e2" acquired by "delete_volume" :: waited 0.071s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:02:51 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de21a49-ebb5-4aef-8ff4-17d174def37d]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bd63ba5d-11cb-4798-a20b-04f845aca7e2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:51 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Created reservations ['bf0b7c89-af6d-42ec-8f09-b80fd0bab604', '4272eaa1-0ac2-4067-8ee0-70d0f09f6b3b', 'a90af6f3-3667-4105-ad39-b52963708acf', '78fa72b0-262a-4e97-9224-cfd4239a43b9'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bd63ba5d-11cb-4798-a20b-04f845aca7e2" returned: 0 in 0.711s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bd63ba5d-11cb-4798-a20b-04f845aca7e2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.226s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:02:52 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Deleted volume successfully.
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-bd63ba5d-11cb-4798-a20b-04f845aca7e2" returned: 0 in 0.458s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Lock "cinder-quobyte-bd63ba5d-11cb-4798-a20b-04f845aca7e2" released by "delete_volume" :: held 1.299s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Acquiring lock "cinder-quobyte-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-48526eac-3632-4496-9748-9ee2e4453e40 tempest-VolumesExtendTest-1857084434 None] Lock "cinder-13ad938f-f520-4f85-ac08-c00652b6052b-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Lock "cinder-quobyte-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5" acquired by "delete_volume" :: waited 0.037s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:02:52 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:02:52 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Flow 'volume_create_manager' (663b2def-4d97-4d55-b697-6084878d989b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09bbc107-2df3-4f7e-8c81-4efa322c60aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[6806f613-2de9-4bb0-b853-9dbfc7db5858]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09bbc107-2df3-4f7e-8c81-4efa322c60aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1270273185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113fee20-ab14-4688-b075-0365794d7a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1977d1ab85e0481eb9ebc298bfa55cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:02:53Z,use_quota=True,user_id='b1a92214a1d64db0b362dc5c10b223ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a447d7e-2e1e-4b51-9ea9-e38c9d34b07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a447d7e-2e1e-4b51-9ea9-e38c9d34b07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0297b9b2-dca1-4d22-875e-bfdbf09c579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0297b9b2-dca1-4d22-875e-bfdbf09c579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '113fee20-ab14-4688-b075-0365794d7a54', 'volume_name': 'volume-113fee20-ab14-4688-b075-0365794d7a54', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27030f52-2105-463f-994d-7f36c6c4b17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27030f52-2105-463f-994d-7f36c6c4b17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c4054b-be37-49fc-b245-83e9c0944513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:53 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Volume 113fee20-ab14-4688-b075-0365794d7a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-113fee20-ab14-4688-b075-0365794d7a54', 'volume_size': 1}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1270273185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113fee20-ab14-4688-b075-0365794d7a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1977d1ab85e0481eb9ebc298bfa55cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:02:53Z,use_quota=True,user_id='b1a92214a1d64db0b362dc5c10b223ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Creating volume 113fee20-ab14-4688-b075-0365794d7a54 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:02:53 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5" returned: 0 in 0.597s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:53 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=109, name=volume-113fee20-ab14-4688-b075-0365794d7a54, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5" returned: 0 in 0.106s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Lock "cinder-quobyte-eed52fb4-7f1f-4380-9b9d-6d6f850b4be5" released by "delete_volume" :: held 1.024s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:02:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54 1073741824" returned: 0 in 0.558s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54" returned: 0 in 0.265s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:54 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] <== create_volume: return (954ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:02:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:54 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c4054b-be37-49fc-b245-83e9c0944513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-113fee20-ab14-4688-b075-0365794d7a54', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:54 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dd8ae1-490f-4aa9-bf9c-f6de6a28e6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:02:54 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Volume volume-113fee20-ab14-4688-b075-0365794d7a54 (113fee20-ab14-4688-b075-0365794d7a54): created successfully
Sep 10 14:02:54 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dd8ae1-490f-4aa9-bf9c-f6de6a28e6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:02:54 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Flow 'volume_create_manager' (663b2def-4d97-4d55-b697-6084878d989b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:02:54 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-7ca58507-100b-4559-9ce9-d2626b0c26cb tempest-VolumesExtendTest-1857084434 None] Created volume successfully.
Sep 10 14:02:54 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Created reservations ['76c9a0ea-4cab-4529-8b6c-7df815725666'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:02:54 devstack cinder-volume[82823]: WARNING cinder.quota [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2107812257 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2107812257, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:02:54 devstack cinder-volume[82823]: WARNING cinder.quota [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2107812257 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2107812257, it is now deprecated. Please use the default quota class for default quota.
Sep 10 14:02:54 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Created reservations ['d39eeab1-182b-4d75-a2d7-21aaabd09b9f', '967a3a1e-1e65-4cc5-8583-3ca8e4627b79', '16c05304-fa84-446f-af8e-483948e10a38', '452880f0-cda0-4d3c-8cec-9670a2dd26f2'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:02:54 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Created reservations ['8d06e654-be84-446c-83cf-c6f1fcd9e392', '7410c88e-a12b-4266-9001-d244bad0c5ed', '4d5b3966-f2a1-4491-a2b6-5ed9063eb13f', 'e44c589a-ee94-49c0-b0e5-ecfad16c312a'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:02:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:02:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:02:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:55 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] Creating offline snapshot 427d0aaf-6116-442a-86f0-ac575219b857 of volume 113fee20-ab14-4688-b075-0365794d7a54 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:02:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.398s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:55 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:02:55 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9d5f00-47ed-430f-bfb5-98266f275b89]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:55 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-742fedab-d6db-42e4-a1eb-99f708542714 tempest-GroupsTest-1331452265 None] Delete group completed successfully.
Sep 10 14:02:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54" returned: 0 in 0.566s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:56 devstack quobyte-client[82845]: System call of process 96323 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:02:56 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=110, name=volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:02:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857 1G" returned: 0 in 0.304s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): qemu-img rebase -u -b volume-113fee20-ab14-4688-b075-0365794d7a54 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] CMD "qemu-img rebase -u -b volume-113fee20-ab14-4688-b075-0365794d7a54 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857" returned: 0 in 0.161s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:02:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857" returned: 0 in 0.148s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:02:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857" returned: 0 in 0.110s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.info" returned: 0 in 0.133s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:02:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.info" returned: 0 in 0.118s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.068s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:57 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-7629d340-5059-4583-b2d9-101ea4f04d5f tempest-VolumesExtendTest-1857084434 None] Create snapshot completed successfully
Sep 10 14:02:58 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-797a07dc-6d11-45ad-9540-97d4e7a2854c tempest-VolumesExtendTest-1857084434 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:02:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-797a07dc-6d11-45ad-9540-97d4e7a2854c tempest-VolumesExtendTest-1857084434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:02:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-797a07dc-6d11-45ad-9540-97d4e7a2854c tempest-VolumesExtendTest-1857084434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:02:58 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[51712a9b-c11d-4b6f-9af5-59fe8037ebe7]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:02:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-797a07dc-6d11-45ad-9540-97d4e7a2854c tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-797a07dc-6d11-45ad-9540-97d4e7a2854c tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54" returned: 0 in 0.526s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-797a07dc-6d11-45ad-9540-97d4e7a2854c tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857 2G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:02:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-797a07dc-6d11-45ad-9540-97d4e7a2854c tempest-VolumesExtendTest-1857084434 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857 2G" returned: 0 in 0.249s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:02:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-797a07dc-6d11-45ad-9540-97d4e7a2854c tempest-VolumesExtendTest-1857084434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.883s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:02:59 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-797a07dc-6d11-45ad-9540-97d4e7a2854c tempest-VolumesExtendTest-1857084434 None] Extend volume completed successfully.
Sep 10 14:03:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Acquiring lock "cinder-427d0aaf-6116-442a-86f0-ac575219b857-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Lock "cinder-427d0aaf-6116-442a-86f0-ac575219b857-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:01 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:03:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Acquiring lock "cinder-quobyte-113fee20-ab14-4688-b075-0365794d7a54" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Lock "cinder-quobyte-113fee20-ab14-4688-b075-0365794d7a54" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Acquiring lock "cinder-quobyte-427d0aaf-6116-442a-86f0-ac575219b857" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Lock "cinder-quobyte-427d0aaf-6116-442a-86f0-ac575219b857" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Deleting offline snapshot 427d0aaf-6116-442a-86f0-ac575219b857 of volume 113fee20-ab14-4688-b075-0365794d7a54 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:03:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] snapshot_file for this snap is: volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:03:01 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[396f1e79-72b2-4606-b7ee-2f9a7db13f3a]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:03:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857" returned: 0 in 0.567s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-113fee20-ab14-4688-b075-0365794d7a54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:03:01 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4d40a5-4471-4775-b6c3-424ad23f1e8a]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:03:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54" returned: 0 in 0.477s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857" returned: 0 in 0.327s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54.427d0aaf-6116-442a-86f0-ac575219b857" returned: 0 in 0.102s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:02 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Lock "cinder-quobyte-427d0aaf-6116-442a-86f0-ac575219b857" released by "_delete_snapshot" :: held 1.866s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:02 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Lock "cinder-quobyte-113fee20-ab14-4688-b075-0365794d7a54" released by "delete_snapshot" :: held 1.896s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:03 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Created reservations ['c71501c1-fff5-49da-8eb9-eb31e7fe6aac', '19e01b36-b834-4ab1-9757-dbd7d01c9afc', 'f15e9fd0-c6cf-459b-ac78-e9ea742cf06e', 'b82a3ca0-4258-47f8-858e-797c5478e186'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:03:03 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Delete snapshot completed successfully.
Sep 10 14:03:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2fb1ae0e-ea33-4d48-a0dd-0872a9de2421 tempest-VolumesExtendTest-1857084434 None] Lock "cinder-427d0aaf-6116-442a-86f0-ac575219b857-delete_snapshot" released by "delete_snapshot" :: held 2.400s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Acquiring lock "cinder-113fee20-ab14-4688-b075-0365794d7a54-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Lock "cinder-113fee20-ab14-4688-b075-0365794d7a54-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:04 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:03:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Acquiring lock "cinder-quobyte-113fee20-ab14-4688-b075-0365794d7a54" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Lock "cinder-quobyte-113fee20-ab14-4688-b075-0365794d7a54" acquired by "delete_volume" :: waited 0.019s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:04 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d04367a-f539-4cb6-8ee6-080f4e9d31ad]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:03:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54" returned: 0 in 0.483s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-113fee20-ab14-4688-b075-0365794d7a54" returned: 0 in 0.140s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Lock "cinder-quobyte-113fee20-ab14-4688-b075-0365794d7a54" released by "delete_volume" :: held 0.796s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:05 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Created reservations ['1b806a44-c0be-44f7-9a9d-ef0f984c3eab', '724381ba-f56b-40ce-94a4-b1d0f65f17be', '547c68cd-9c13-48f1-96bf-0f71de244281', '45cba7c9-a803-4633-accf-63c90a0caf10'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:03:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:03:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:03:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.093s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:05 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:03:06 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Deleted volume successfully.
Sep 10 14:03:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1d4c352d-4a79-42e3-9bfd-35392b339f17 tempest-VolumesExtendTest-1857084434 None] Lock "cinder-113fee20-ab14-4688-b075-0365794d7a54-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:11 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Flow 'volume_create_manager' (e84056ca-9c7a-4382-b6c1-3b4faeecff6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aecc666c-3cd4-452e-8eb9-09fac6b16987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aecc666c-3cd4-452e-8eb9-09fac6b16987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1584601588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ced110-b6b1-4681-bed9-373df976a9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d121c9914371491d8d12ead7fcbd0d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:03:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:03:11Z,use_quota=True,user_id='a65a7d976b554bfebdded02dab083c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acaf0f92-354c-480c-8ae8-a0a171a99109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acaf0f92-354c-480c-8ae8-a0a171a99109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d464d233-ecd2-483c-9402-07b22f824dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d464d233-ecd2-483c-9402-07b22f824dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65ced110-b6b1-4681-bed9-373df976a9c8', 'volume_name': 'volume-65ced110-b6b1-4681-bed9-373df976a9c8', 'volume_size': 2}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb0d43b-6f5e-4a80-bb2b-19ca0546fcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb0d43b-6f5e-4a80-bb2b-19ca0546fcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4750b9cf-f708-4f07-9ab5-cdf763a0929a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:11 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Volume 65ced110-b6b1-4681-bed9-373df976a9c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65ced110-b6b1-4681-bed9-373df976a9c8', 'volume_size': 2}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1584601588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ced110-b6b1-4681-bed9-373df976a9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d121c9914371491d8d12ead7fcbd0d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:03:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:03:11Z,use_quota=True,user_id='a65a7d976b554bfebdded02dab083c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Creating volume 65ced110-b6b1-4681-bed9-373df976a9c8 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:03:11 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:03:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8 2147483648 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:11 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=112, name=volume-65ced110-b6b1-4681-bed9-373df976a9c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:03:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8 2147483648" returned: 0 in 0.529s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8" returned: 0 in 0.115s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:12 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] <== create_volume: return (721ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:03:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4750b9cf-f708-4f07-9ab5-cdf763a0929a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ced110-b6b1-4681-bed9-373df976a9c8', 'volume_size': 2}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe45996-eee4-441d-9336-c47de28e40a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:12 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Volume volume-65ced110-b6b1-4681-bed9-373df976a9c8 (65ced110-b6b1-4681-bed9-373df976a9c8): created successfully
Sep 10 14:03:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe45996-eee4-441d-9336-c47de28e40a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:12 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Flow 'volume_create_manager' (e84056ca-9c7a-4382-b6c1-3b4faeecff6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:03:12 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-6f2cdd08-fc86-4a47-989a-5fb22ae23765 tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Created volume successfully.
Sep 10 14:03:13 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:03:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:13 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Creating offline snapshot 5c2992dd-124a-47c7-9cef-96409419b29d of volume 65ced110-b6b1-4681-bed9-373df976a9c8 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:03:13 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c173da-33df-4df6-be87-27e2ec2d4049]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:03:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8" returned: 0 in 0.455s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d 2G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:14 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=113, name=volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:03:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d 2G" returned: 0 in 0.416s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): qemu-img rebase -u -b volume-65ced110-b6b1-4681-bed9-373df976a9c8 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "qemu-img rebase -u -b volume-65ced110-b6b1-4681-bed9-373df976a9c8 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d" returned: 0 in 0.292s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:03:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d" returned: 0 in 0.163s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:03:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d" returned: 0 in 0.128s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.info" returned: 0 in 0.121s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:03:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.info" returned: 0 in 0.094s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:16 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-7ad09121-bef5-4620-8c92-6c5175fd92fc tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Create snapshot completed successfully
Sep 10 14:03:16 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Acquiring lock "cinder-5c2992dd-124a-47c7-9cef-96409419b29d-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "cinder-5c2992dd-124a-47c7-9cef-96409419b29d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:17 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:03:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Acquiring lock "cinder-quobyte-65ced110-b6b1-4681-bed9-373df976a9c8" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "cinder-quobyte-65ced110-b6b1-4681-bed9-373df976a9c8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Acquiring lock "cinder-quobyte-5c2992dd-124a-47c7-9cef-96409419b29d" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "cinder-quobyte-5c2992dd-124a-47c7-9cef-96409419b29d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:17 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Deleting offline snapshot 5c2992dd-124a-47c7-9cef-96409419b29d of volume 65ced110-b6b1-4681-bed9-373df976a9c8 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:03:17 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] snapshot_file for this snap is: volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:03:17 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[055c27ae-5290-47f2-8723-3f13548f4227]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:03:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d" returned: 0 in 0.449s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:17 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65ced110-b6b1-4681-bed9-373df976a9c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:03:17 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[114ff413-55f0-45fb-8435-8d5810f65571]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:03:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8" returned: 0 in 0.462s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d" returned: 0 in 0.280s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8.5c2992dd-124a-47c7-9cef-96409419b29d" returned: 0 in 0.097s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "cinder-quobyte-5c2992dd-124a-47c7-9cef-96409419b29d" released by "_delete_snapshot" :: held 1.610s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "cinder-quobyte-65ced110-b6b1-4681-bed9-373df976a9c8" released by "delete_snapshot" :: held 1.635s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:19 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Created reservations ['d6d918c4-9a33-466c-b84e-5a0413b411dd', '396a68a8-7681-46c9-8632-fdd808392796', 'b10ebf70-1968-416d-ac8a-69f6a73c2878', '79a8382a-3524-4252-9c6c-3097b315a601'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:03:19 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Delete snapshot completed successfully.
Sep 10 14:03:19 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-ebd4779f-3f0f-47a6-85e6-5dbb2a36f00e tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "cinder-5c2992dd-124a-47c7-9cef-96409419b29d-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Acquiring lock "cinder-65ced110-b6b1-4681-bed9-373df976a9c8-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "cinder-65ced110-b6b1-4681-bed9-373df976a9c8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:20 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:03:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Acquiring lock "cinder-quobyte-65ced110-b6b1-4681-bed9-373df976a9c8" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "cinder-quobyte-65ced110-b6b1-4681-bed9-373df976a9c8" acquired by "delete_volume" :: waited 0.022s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:20 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec7602c-ad79-46c3-95a6-25b4ff3e9684]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:03:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8" returned: 0 in 0.433s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-65ced110-b6b1-4681-bed9-373df976a9c8" returned: 0 in 0.167s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:21 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "cinder-quobyte-65ced110-b6b1-4681-bed9-373df976a9c8" released by "delete_volume" :: held 0.856s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:21 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Created reservations ['f783ae43-7383-40f9-8b78-8693206fcf7b', '2e6006d9-b51d-42ab-abf9-b1d91f3ecd0f', 'adc8b60e-5545-4113-b2a4-f1a3a86f9dfa', '4bc62762-5a1e-4f2f-96a6-216bbac75ec9'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:03:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:03:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:03:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.105s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:22 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:03:22 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Deleted volume successfully.
Sep 10 14:03:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-26e0ef88-3c0b-4d60-a041-c9813d850ffa tempest-VolumesSnapshotNegativeTestJSON-1009164741 None] Lock "cinder-65ced110-b6b1-4681-bed9-373df976a9c8-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=95,cinder:UPDATE=113,cinder:DELETE=6,cinder:INSERT=30 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=92,cinder:SELECT=79,cinder:INSERT=22,cinder:DELETE=7 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:03:28 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Flow 'volume_create_manager' (70d6e02e-f962-4a75-b1f9-07d8c9d52de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0169acd9-5692-48a9-85a7-fe3ee521d2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0169acd9-5692-48a9-85a7-fe3ee521d2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1624007858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b5c7e1-031f-4592-9fa5-eff423558087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af8fb77eff5450ea19bfce61f784e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:03:28Z,use_quota=True,user_id='6128d5c188cd4d33a8fc673b526a3a7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca299388-31d6-437d-9632-666dfb092bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca299388-31d6-437d-9632-666dfb092bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb91d229-ec80-4360-94a4-ab6cffcac0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb91d229-ec80-4360-94a4-ab6cffcac0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35b5c7e1-031f-4592-9fa5-eff423558087', 'volume_name': 'volume-35b5c7e1-031f-4592-9fa5-eff423558087', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379a82aa-6fb9-4e5a-8c67-de5777766aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379a82aa-6fb9-4e5a-8c67-de5777766aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75aa359a-9dcf-4d31-8bbf-ba8cccc60740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:28 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Volume 35b5c7e1-031f-4592-9fa5-eff423558087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35b5c7e1-031f-4592-9fa5-eff423558087', 'volume_size': 1}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1624007858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b5c7e1-031f-4592-9fa5-eff423558087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af8fb77eff5450ea19bfce61f784e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:03:28Z,use_quota=True,user_id='6128d5c188cd4d33a8fc673b526a3a7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Creating volume 35b5c7e1-031f-4592-9fa5-eff423558087 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:03:28 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:03:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-35b5c7e1-031f-4592-9fa5-eff423558087 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:28 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=115, name=volume-35b5c7e1-031f-4592-9fa5-eff423558087, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-35b5c7e1-031f-4592-9fa5-eff423558087 1073741824" returned: 0 in 0.433s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-35b5c7e1-031f-4592-9fa5-eff423558087 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-35b5c7e1-031f-4592-9fa5-eff423558087" returned: 0 in 0.205s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] <== create_volume: return (718ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75aa359a-9dcf-4d31-8bbf-ba8cccc60740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b5c7e1-031f-4592-9fa5-eff423558087', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb851ad8-ea75-43fd-891c-757c1796d007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:29 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Volume volume-35b5c7e1-031f-4592-9fa5-eff423558087 (35b5c7e1-031f-4592-9fa5-eff423558087): created successfully
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb851ad8-ea75-43fd-891c-757c1796d007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Flow 'volume_create_manager' (70d6e02e-f962-4a75-b1f9-07d8c9d52de0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:03:29 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-802bc852-2039-4535-ac24-ad856036d620 tempest-VolumesServicesTestJSON-2003741416 None] Created volume successfully.
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.182s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:03:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Acquiring lock "cinder-35b5c7e1-031f-4592-9fa5-eff423558087-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Lock "cinder-35b5c7e1-031f-4592-9fa5-eff423558087-delete_volume" acquired by "delete_volume" :: waited 0.147s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:31 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:03:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Acquiring lock "cinder-quobyte-35b5c7e1-031f-4592-9fa5-eff423558087" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Lock "cinder-quobyte-35b5c7e1-031f-4592-9fa5-eff423558087" acquired by "delete_volume" :: waited 0.011s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:31 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fd2411-8c0c-4610-af8b-b690ec1ea541]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:03:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-35b5c7e1-031f-4592-9fa5-eff423558087 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-35b5c7e1-031f-4592-9fa5-eff423558087" returned: 0 in 0.492s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-35b5c7e1-031f-4592-9fa5-eff423558087 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-35b5c7e1-031f-4592-9fa5-eff423558087" returned: 0 in 0.151s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Lock "cinder-quobyte-35b5c7e1-031f-4592-9fa5-eff423558087" released by "delete_volume" :: held 0.883s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:32 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Created reservations ['177d6efe-43f2-44fd-af22-9f0a1235d10c', 'e3837044-02db-4856-b9f5-7566574a4ad0', '16ff83fe-28a9-4ea3-9926-095a93a7312f', '7777126b-8ceb-4f5a-95c2-72627faa8631'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:03:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:03:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:03:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.103s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:32 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:03:32 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Deleted volume successfully.
Sep 10 14:03:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-22b5ea75-6615-4886-8082-6c2f94e940e7 tempest-VolumesServicesTestJSON-2003741416 None] Lock "cinder-35b5c7e1-031f-4592-9fa5-eff423558087-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:40 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Flow 'volume_create_manager' (ba6117da-17f3-460f-888b-1c82c1c69fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc96e88-0a11-428b-98dc-04f40fce7bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc96e88-0a11-428b-98dc-04f40fce7bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-717287686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e5e0dd-5152-449f-ad2e-52e33d5da4f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a12b88c48a4c53b3b45b3848b41580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:03:40Z,use_quota=True,user_id='a47090f1897641a38d197ce772a57070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab67072a-7772-4e5c-81d6-4297206d7de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab67072a-7772-4e5c-81d6-4297206d7de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5aff8c-8474-4507-89d9-63edc5bae654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5aff8c-8474-4507-89d9-63edc5bae654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43e5e0dd-5152-449f-ad2e-52e33d5da4f2', 'volume_name': 'volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd2ba06-e91c-482c-8236-8f295472f18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd2ba06-e91c-482c-8236-8f295472f18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36ebeb9-e866-4678-a4f7-dd593ce1abeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:40 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Volume 43e5e0dd-5152-449f-ad2e-52e33d5da4f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2', 'volume_size': 1}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-717287686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e5e0dd-5152-449f-ad2e-52e33d5da4f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a12b88c48a4c53b3b45b3848b41580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:03:40Z,use_quota=True,user_id='a47090f1897641a38d197ce772a57070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Creating volume 43e5e0dd-5152-449f-ad2e-52e33d5da4f2 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:03:40 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:03:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:40 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=116, name=volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:03:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2 1073741824" returned: 0 in 0.357s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2" returned: 0 in 0.093s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] <== create_volume: return (531ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:03:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.543s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36ebeb9-e866-4678-a4f7-dd593ce1abeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76cd2336-c07d-462b-8ed9-93366d4e94fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:41 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Volume volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2 (43e5e0dd-5152-449f-ad2e-52e33d5da4f2): created successfully
Sep 10 14:03:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76cd2336-c07d-462b-8ed9-93366d4e94fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Flow 'volume_create_manager' (ba6117da-17f3-460f-888b-1c82c1c69fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:03:41 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-bb57a0bb-09c5-47ab-afe1-0d2a733c7f12 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Created volume successfully.
Sep 10 14:03:42 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:03:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:42 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Creating offline snapshot a4e8798c-ce97-45ec-bc1a-001c99cc60d6 of volume 43e5e0dd-5152-449f-ad2e-52e33d5da4f2 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:03:43 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[718b98da-82b6-4624-b9b2-eca94349fd4b]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:03:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2" returned: 0 in 0.463s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:43 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=117, name=volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:03:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6 1G" returned: 0 in 0.245s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): qemu-img rebase -u -b volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "qemu-img rebase -u -b volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6" returned: 0 in 0.156s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:03:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6" returned: 0 in 0.103s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:44 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:03:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6" returned: 0 in 0.094s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.info" returned: 0 in 0.091s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:44 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:03:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.info" returned: 0 in 0.108s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.609s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:44 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-adbd2caa-ca15-41fc-a26f-256cbdb9254b tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Create snapshot completed successfully
Sep 10 14:03:45 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Acquiring lock "cinder-a4e8798c-ce97-45ec-bc1a-001c99cc60d6-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "cinder-a4e8798c-ce97-45ec-bc1a-001c99cc60d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:46 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:03:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Acquiring lock "cinder-quobyte-43e5e0dd-5152-449f-ad2e-52e33d5da4f2" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "cinder-quobyte-43e5e0dd-5152-449f-ad2e-52e33d5da4f2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Acquiring lock "cinder-quobyte-a4e8798c-ce97-45ec-bc1a-001c99cc60d6" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "cinder-quobyte-a4e8798c-ce97-45ec-bc1a-001c99cc60d6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:46 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Deleting offline snapshot a4e8798c-ce97-45ec-bc1a-001c99cc60d6 of volume 43e5e0dd-5152-449f-ad2e-52e33d5da4f2 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:03:46 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] snapshot_file for this snap is: volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:03:46 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e83091-9ccd-48d4-a14e-7d3cc8da9c19]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:03:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:46 devstack quobyte-client[82845]: System call of process 96460 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:03:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6" returned: 0 in 0.762s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:46 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:03:46 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c4070e-c881-4cac-ad3a-46ed1ec80164]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:03:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2" returned: 0 in 0.568s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6" returned: 0 in 0.264s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2.a4e8798c-ce97-45ec-bc1a-001c99cc60d6" returned: 0 in 0.098s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:48 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "cinder-quobyte-a4e8798c-ce97-45ec-bc1a-001c99cc60d6" released by "_delete_snapshot" :: held 2.032s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:48 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "cinder-quobyte-43e5e0dd-5152-449f-ad2e-52e33d5da4f2" released by "delete_snapshot" :: held 2.060s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:48 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Created reservations ['154ec7ec-b2ef-4037-8d58-779b43ffa486', '525b4f2c-9f38-4c16-a222-c0d4478446bb', '19a70621-b90e-4125-8b8f-52cc94615f14', '880711b7-3954-4604-b465-0e9899171924'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:03:48 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Delete snapshot completed successfully.
Sep 10 14:03:48 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7790aab1-e5e5-46c4-9ee2-253324a383b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "cinder-a4e8798c-ce97-45ec-bc1a-001c99cc60d6-delete_snapshot" released by "delete_snapshot" :: held 2.587s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Acquiring lock "cinder-43e5e0dd-5152-449f-ad2e-52e33d5da4f2-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "cinder-43e5e0dd-5152-449f-ad2e-52e33d5da4f2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:49 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:03:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Acquiring lock "cinder-quobyte-43e5e0dd-5152-449f-ad2e-52e33d5da4f2" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:03:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "cinder-quobyte-43e5e0dd-5152-449f-ad2e-52e33d5da4f2" acquired by "delete_volume" :: waited 0.015s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:03:49 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeacaa6-1213-4d74-be73-2aff9e6af94c]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:03:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2" returned: 0 in 0.602s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-43e5e0dd-5152-449f-ad2e-52e33d5da4f2" returned: 0 in 0.109s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:50 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "cinder-quobyte-43e5e0dd-5152-449f-ad2e-52e33d5da4f2" released by "delete_volume" :: held 0.895s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:50 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Created reservations ['0dcf699f-7daa-4985-97ab-1911ea8b287a', '2e68a89e-b59b-4b28-a43a-28ad71623b1e', 'ab558f9d-b4db-4bba-8b43-cdc43ad06310', 'be60292d-1946-4571-8225-70282e85b392'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:03:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:03:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:03:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.115s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:51 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:03:51 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Deleted volume successfully.
Sep 10 14:03:51 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f9757c7c-ca11-450c-b03f-5d22719b0fd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-316084239 None] Lock "cinder-43e5e0dd-5152-449f-ad2e-52e33d5da4f2-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:03:54 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Flow 'volume_create_manager' (93f2125a-6831-4809-acac-abca9fc9c312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f55ffa-3b64-4bb4-8d54-f6423ee24364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f55ffa-3b64-4bb4-8d54-f6423ee24364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-7791614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50025e2-9885-404d-9e44-56c4e3dd98e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0824d25c6c1947e68f8bd439a91ced84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:03:54Z,use_quota=True,user_id='31f45e002d804d05a03134050fcc8f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81187834-1faa-42b6-b64a-1969b3636a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81187834-1faa-42b6-b64a-1969b3636a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c077c75-4209-4540-b46d-ed19184857e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c077c75-4209-4540-b46d-ed19184857e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50025e2-9885-404d-9e44-56c4e3dd98e3', 'volume_name': 'volume-f50025e2-9885-404d-9e44-56c4e3dd98e3', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcfd86a3-fe9b-4474-9462-09b38a209a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcfd86a3-fe9b-4474-9462-09b38a209a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad00979-8eb9-4211-b526-96798ccaf79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:54 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume f50025e2-9885-404d-9e44-56c4e3dd98e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50025e2-9885-404d-9e44-56c4e3dd98e3', 'volume_size': 1}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-7791614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50025e2-9885-404d-9e44-56c4e3dd98e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0824d25c6c1947e68f8bd439a91ced84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:03:54Z,use_quota=True,user_id='31f45e002d804d05a03134050fcc8f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Creating volume f50025e2-9885-404d-9e44-56c4e3dd98e3 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:03:54 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:03:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f50025e2-9885-404d-9e44-56c4e3dd98e3 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:54 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=119, name=volume-f50025e2-9885-404d-9e44-56c4e3dd98e3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f50025e2-9885-404d-9e44-56c4e3dd98e3 1073741824" returned: 0 in 0.610s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f50025e2-9885-404d-9e44-56c4e3dd98e3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:55 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Flow 'volume_create_manager' (d663319c-e4b4-419f-b495-f699dd51db4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307afeba-0688-424a-a188-8a814880521e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f50025e2-9885-404d-9e44-56c4e3dd98e3" returned: 0 in 0.581s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] <== create_volume: return (1224ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307afeba-0688-424a-a188-8a814880521e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-752956288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7637446-cabe-43c0-8ba9-db0ef55a4c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0824d25c6c1947e68f8bd439a91ced84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:03:55Z,use_quota=True,user_id='31f45e002d804d05a03134050fcc8f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a89ab17-b2a6-49e0-915b-c7617dc3398e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a89ab17-b2a6-49e0-915b-c7617dc3398e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f76394f-2821-41df-9ef0-87c55203f5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f76394f-2821-41df-9ef0-87c55203f5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7637446-cabe-43c0-8ba9-db0ef55a4c10', 'volume_name': 'volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a271a9-f0e8-4099-82ca-8679f2025fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a271a9-f0e8-4099-82ca-8679f2025fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88e4753-930a-4afa-8f1f-2e70e41f748f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:55 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume b7637446-cabe-43c0-8ba9-db0ef55a4c10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10', 'volume_size': 1}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-752956288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7637446-cabe-43c0-8ba9-db0ef55a4c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0824d25c6c1947e68f8bd439a91ced84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:03:55Z,use_quota=True,user_id='31f45e002d804d05a03134050fcc8f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Creating volume b7637446-cabe-43c0-8ba9-db0ef55a4c10 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:03:55 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:03:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:56 devstack quobyte-client[82845]: System call of process 96480 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:03:56 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=120, name=volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:03:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad00979-8eb9-4211-b526-96798ccaf79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50025e2-9885-404d-9e44-56c4e3dd98e3', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c380d507-1e28-4a34-b0f6-064211a9b9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10 1073741824" returned: 0 in 0.584s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:03:56 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume volume-f50025e2-9885-404d-9e44-56c4e3dd98e3 (f50025e2-9885-404d-9e44-56c4e3dd98e3): created successfully
Sep 10 14:03:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c380d507-1e28-4a34-b0f6-064211a9b9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:56 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Flow 'volume_create_manager' (93f2125a-6831-4809-acac-abca9fc9c312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:03:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10" returned: 0 in 0.404s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:03:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] <== create_volume: return (1011ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:03:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:03:57 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-0782268b-9f37-40ca-8d72-30e76f1bd912 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Created volume successfully.
Sep 10 14:03:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88e4753-930a-4afa-8f1f-2e70e41f748f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a242e28f-f766-43a7-9738-d53cbafd271b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:03:57 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10 (b7637446-cabe-43c0-8ba9-db0ef55a4c10): created successfully
Sep 10 14:03:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a242e28f-f766-43a7-9738-d53cbafd271b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:03:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Flow 'volume_create_manager' (d663319c-e4b4-419f-b495-f699dd51db4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:03:57 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-10f9e9cd-5c5a-4ae1-8806-6eb286b89146 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Created volume successfully.
Sep 10 14:04:07 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=41,cinder:SELECT=20,cinder:DELETE=4,cinder:INSERT=5 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:04:07 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=20,cinder:UPDATE=20,cinder:DELETE=3,cinder:INSERT=7 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:04:10 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Flow 'volume_create_manager' (23dfbde0-7353-49a0-b07a-86a9cee2edad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb9b705-d59a-429b-bfec-339b65b1c636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb9b705-d59a-429b-bfec-339b65b1c636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1468415627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b984366cba940029760054e15455ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:11Z,use_quota=True,user_id='186ee5166f0e4327bba19d87f485ca7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbdf1614-4718-4fab-985b-e85720e241c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbdf1614-4718-4fab-985b-e85720e241c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6158ad-60b3-4fb4-a673-807506098ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6158ad-60b3-4fb4-a673-807506098ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744', 'volume_name': 'volume-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18eaa72d-952b-4528-925e-fef3b6ca25fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18eaa72d-952b-4528-925e-fef3b6ca25fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a0c344-1b84-4cc9-940e-b07c3242af44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:04:10 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Volume 2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744', 'volume_size': 1}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1468415627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b984366cba940029760054e15455ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:11Z,use_quota=True,user_id='186ee5166f0e4327bba19d87f485ca7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Creating volume 2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:04:10 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:04:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:04:10 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=121, name=volume-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:04:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744 1073741824" returned: 0 in 0.314s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:04:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:04:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744" returned: 0 in 0.091s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:04:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] <== create_volume: return (469ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:04:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.479s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:04:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a0c344-1b84-4cc9-940e-b07c3242af44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:04:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9778c6-f876-4104-a07a-00c8d4af46a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:04:11 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Volume volume-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744 (2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744): created successfully
Sep 10 14:04:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9778c6-f876-4104-a07a-00c8d4af46a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:04:11 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Flow 'volume_create_manager' (23dfbde0-7353-49a0-b07a-86a9cee2edad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:04:11 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-6d486b6a-ba21-4376-b143-22baef0ca41b tempest-VolumesMetadataTest-2063593827 None] Created volume successfully.
Sep 10 14:04:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Acquiring lock "cinder-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:04:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Lock "cinder-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:04:14 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:04:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Acquiring lock "cinder-quobyte-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:04:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Lock "cinder-quobyte-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744" acquired by "delete_volume" :: waited 0.011s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:04:14 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea92c4d-a0fe-4263-bde3-7197d25bda10]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:04:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:04:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744" returned: 0 in 0.452s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:04:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:04:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744" returned: 0 in 0.099s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:04:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Lock "cinder-quobyte-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744" released by "delete_volume" :: held 0.727s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:04:15 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Created reservations ['b271fd58-eb7e-4fbd-8f94-f38cf4f9fff8', '2477cf1e-595c-4481-b836-5d0821f20e27', '281c8977-c34e-4dd1-93b7-ab184c99da6d', '126022a0-5a3c-4c34-afe1-710613652ea5'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:04:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:04:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:04:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:04:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:04:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:04:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:04:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.114s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:04:15 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:04:15 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Deleted volume successfully.
Sep 10 14:04:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-24565255-f5bd-4072-b390-fb74c051545f tempest-VolumesMetadataTest-2063593827 None] Lock "cinder-2ecaf4a4-de7b-4971-a3d2-8ba8c81b2744-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:04:25 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=13,cinder:SELECT=4,cinder:INSERT=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:04:25 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=7,cinder:DELETE=2,cinder:INSERT=3 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:04:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 14:04:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:04:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:04:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:04:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:04:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.070s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:04:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:04:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.222s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:04:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:04:36 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:04:36 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Flow 'volume_create_manager' (3ecf798b-6c80-41af-8bab-3ec12f2ccea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e98ad07-673f-4162-94a4-1114ddf43d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e98ad07-673f-4162-94a4-1114ddf43d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-297475392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e897af2-fb12-4dd1-9560-b0efa76fd090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f9b4269296b4d4ab02f5a2ac70c407b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:37Z,use_quota=True,user_id='2bcc0574fbc74b61a2deaaf3f51d06eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3daad5-e7bc-47cb-8e2f-e4a917012f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3daad5-e7bc-47cb-8e2f-e4a917012f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb0a207-2533-4387-8975-290b93a22604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb0a207-2533-4387-8975-290b93a22604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e897af2-fb12-4dd1-9560-b0efa76fd090', 'volume_name': 'volume-3e897af2-fb12-4dd1-9560-b0efa76fd090', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a5e1cd-5e09-44cf-b748-d7b67fe4749b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a5e1cd-5e09-44cf-b748-d7b67fe4749b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c300ca2a-89a0-48e0-812d-7923670605a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:04:37 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Volume 3e897af2-fb12-4dd1-9560-b0efa76fd090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e897af2-fb12-4dd1-9560-b0efa76fd090', 'volume_size': 1}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-297475392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e897af2-fb12-4dd1-9560-b0efa76fd090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f9b4269296b4d4ab02f5a2ac70c407b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:04:37Z,use_quota=True,user_id='2bcc0574fbc74b61a2deaaf3f51d06eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Creating volume 3e897af2-fb12-4dd1-9560-b0efa76fd090 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:04:37 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:04:37 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=122, name=volume-3e897af2-fb12-4dd1-9560-b0efa76fd090, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 1073741824" returned: 0 in 0.421s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090" returned: 0 in 0.149s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] <== create_volume: return (665ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:04:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:04:38 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c300ca2a-89a0-48e0-812d-7923670605a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e897af2-fb12-4dd1-9560-b0efa76fd090', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:04:38 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8013425a-c9dd-42f6-92da-582a562d4a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:04:38 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Volume volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 (3e897af2-fb12-4dd1-9560-b0efa76fd090): created successfully
Sep 10 14:04:38 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8013425a-c9dd-42f6-92da-582a562d4a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:04:38 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Flow 'volume_create_manager' (3ecf798b-6c80-41af-8bab-3ec12f2ccea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:04:38 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-95ab86ff-a7d8-4939-94f3-31728bb20d96 tempest-VolumesActionsTest-926807224 None] Created volume successfully.
Sep 10 14:04:48 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:04:48 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:05:09 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8d05592f-bd3d-4de6-8b4c-71c41dfbd31e tempest-VolumesActionsTest-926807224 None] Acquiring lock "cinder-3e897af2-fb12-4dd1-9560-b0efa76fd090" by "attach_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:05:09 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8d05592f-bd3d-4de6-8b4c-71c41dfbd31e tempest-VolumesActionsTest-926807224 None] Lock "cinder-3e897af2-fb12-4dd1-9560-b0efa76fd090" acquired by "attach_volume" :: waited 0.030s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:05:09 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-8d05592f-bd3d-4de6-8b4c-71c41dfbd31e tempest-VolumesActionsTest-926807224 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:05:09 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-8d05592f-bd3d-4de6-8b4c-71c41dfbd31e tempest-VolumesActionsTest-926807224 None] Attaching volume 3e897af2-fb12-4dd1-9560-b0efa76fd090 to instance 3f47e332-9319-4fd2-b473-eff2bc2c7340 at mountpoint /dev/vdb on host None.
Sep 10 14:05:09 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-8d05592f-bd3d-4de6-8b4c-71c41dfbd31e tempest-VolumesActionsTest-926807224 None] Attach volume completed successfully.
Sep 10 14:05:09 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8d05592f-bd3d-4de6-8b4c-71c41dfbd31e tempest-VolumesActionsTest-926807224 None] Lock "cinder-3e897af2-fb12-4dd1-9560-b0efa76fd090" released by "attach_volume" :: held 0.324s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:05:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c9b288e5-4953-41cf-aa15-b6e4174303a1 tempest-VolumesActionsTest-926807224 None] Acquiring lock "cinder-3e897af2-fb12-4dd1-9560-b0efa76fd090-detach_volume" by "detach_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:05:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c9b288e5-4953-41cf-aa15-b6e4174303a1 tempest-VolumesActionsTest-926807224 None] Lock "cinder-3e897af2-fb12-4dd1-9560-b0efa76fd090-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:05:10 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-c9b288e5-4953-41cf-aa15-b6e4174303a1 tempest-VolumesActionsTest-926807224 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:05:10 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-c9b288e5-4953-41cf-aa15-b6e4174303a1 tempest-VolumesActionsTest-926807224 None] Detaching volume 3e897af2-fb12-4dd1-9560-b0efa76fd090 from instance 3f47e332-9319-4fd2-b473-eff2bc2c7340.
Sep 10 14:05:10 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-c9b288e5-4953-41cf-aa15-b6e4174303a1 tempest-VolumesActionsTest-926807224 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:05:10 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-c9b288e5-4953-41cf-aa15-b6e4174303a1 tempest-VolumesActionsTest-926807224 None] Detach volume completed successfully.
Sep 10 14:05:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c9b288e5-4953-41cf-aa15-b6e4174303a1 tempest-VolumesActionsTest-926807224 None] Lock "cinder-3e897af2-fb12-4dd1-9560-b0efa76fd090-detach_volume" released by "detach_volume" :: held 0.149s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:05:20 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:05:20 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:05:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 14:05:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:05:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:05:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:05:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:05:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:05:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:05:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.253s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:05:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:05:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-a5871b21-c527-4885-be90-8d1c4a520c33 req-889f3bcb-9b0c-4593-852f-cf75397009ef tempest-TestServerVolumeAttachmentScenario-2057656121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:05:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-a5871b21-c527-4885-be90-8d1c4a520c33 req-889f3bcb-9b0c-4593-852f-cf75397009ef tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:05:37 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec7f25d-22cb-4905-ac8a-cf025b8fe14b]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:05:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-a5871b21-c527-4885-be90-8d1c4a520c33 req-889f3bcb-9b0c-4593-852f-cf75397009ef tempest-TestServerVolumeAttachmentScenario-2057656121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f50025e2-9885-404d-9e44-56c4e3dd98e3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:05:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-a5871b21-c527-4885-be90-8d1c4a520c33 req-889f3bcb-9b0c-4593-852f-cf75397009ef tempest-TestServerVolumeAttachmentScenario-2057656121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f50025e2-9885-404d-9e44-56c4e3dd98e3" returned: 0 in 0.545s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:05:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-a5871b21-c527-4885-be90-8d1c4a520c33 req-889f3bcb-9b0c-4593-852f-cf75397009ef tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.638s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:05:38 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-a5871b21-c527-4885-be90-8d1c4a520c33 req-889f3bcb-9b0c-4593-852f-cf75397009ef tempest-TestServerVolumeAttachmentScenario-2057656121 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-f50025e2-9885-404d-9e44-56c4e3dd98e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29f3c7f3-f57f-485b-bfd6-1f740442f1e8', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 14:05:38 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-a5871b21-c527-4885-be90-8d1c4a520c33 req-889f3bcb-9b0c-4593-852f-cf75397009ef tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:05:38 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-a5871b21-c527-4885-be90-8d1c4a520c33 req-889f3bcb-9b0c-4593-852f-cf75397009ef tempest-TestServerVolumeAttachmentScenario-2057656121 None] attachment_update completed successfully.
Sep 10 14:05:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c7248b6d-211d-4333-8be7-13c82b851aad tempest-VolumesActionsTest-926807224 None] Acquiring lock "cinder-3e897af2-fb12-4dd1-9560-b0efa76fd090" by "attach_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:05:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c7248b6d-211d-4333-8be7-13c82b851aad tempest-VolumesActionsTest-926807224 None] Lock "cinder-3e897af2-fb12-4dd1-9560-b0efa76fd090" acquired by "attach_volume" :: waited 0.106s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:05:46 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-c7248b6d-211d-4333-8be7-13c82b851aad tempest-VolumesActionsTest-926807224 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:05:46 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-c7248b6d-211d-4333-8be7-13c82b851aad tempest-VolumesActionsTest-926807224 None] Attaching volume 3e897af2-fb12-4dd1-9560-b0efa76fd090 to instance 2672ab21-6b42-4260-955f-959a3a1543ae at mountpoint /dev/vdb on host None.
Sep 10 14:05:47 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-c7248b6d-211d-4333-8be7-13c82b851aad tempest-VolumesActionsTest-926807224 None] Attach volume completed successfully.
Sep 10 14:05:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c7248b6d-211d-4333-8be7-13c82b851aad tempest-VolumesActionsTest-926807224 None] Lock "cinder-3e897af2-fb12-4dd1-9560-b0efa76fd090" released by "attach_volume" :: held 0.255s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:05:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6dae122c-2034-4122-8a0c-8a655e938b30 tempest-VolumesActionsTest-926807224 None] Acquiring lock "cinder-3e897af2-fb12-4dd1-9560-b0efa76fd090-detach_volume" by "detach_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:05:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6dae122c-2034-4122-8a0c-8a655e938b30 tempest-VolumesActionsTest-926807224 None] Lock "cinder-3e897af2-fb12-4dd1-9560-b0efa76fd090-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:05:47 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-6dae122c-2034-4122-8a0c-8a655e938b30 tempest-VolumesActionsTest-926807224 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:05:47 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-6dae122c-2034-4122-8a0c-8a655e938b30 tempest-VolumesActionsTest-926807224 None] Detaching volume 3e897af2-fb12-4dd1-9560-b0efa76fd090 from instance 2672ab21-6b42-4260-955f-959a3a1543ae.
Sep 10 14:05:47 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-6dae122c-2034-4122-8a0c-8a655e938b30 tempest-VolumesActionsTest-926807224 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:05:47 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-6dae122c-2034-4122-8a0c-8a655e938b30 tempest-VolumesActionsTest-926807224 None] Detach volume completed successfully.
Sep 10 14:05:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6dae122c-2034-4122-8a0c-8a655e938b30 tempest-VolumesActionsTest-926807224 None] Lock "cinder-3e897af2-fb12-4dd1-9560-b0efa76fd090-detach_volume" released by "detach_volume" :: held 0.141s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:05:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-c4aa7b0d-a3d3-400f-a9f2-e3872c8a57b1 req-000cdece-74bc-443f-902f-bfa42e91c5ab tempest-TestServerVolumeAttachmentScenario-2057656121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:05:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-c4aa7b0d-a3d3-400f-a9f2-e3872c8a57b1 req-000cdece-74bc-443f-902f-bfa42e91c5ab tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:05:56 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85f0f82-32b7-4856-9fb2-9f81ccb37fac]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:05:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-c4aa7b0d-a3d3-400f-a9f2-e3872c8a57b1 req-000cdece-74bc-443f-902f-bfa42e91c5ab tempest-TestServerVolumeAttachmentScenario-2057656121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:05:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-c4aa7b0d-a3d3-400f-a9f2-e3872c8a57b1 req-000cdece-74bc-443f-902f-bfa42e91c5ab tempest-TestServerVolumeAttachmentScenario-2057656121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10" returned: 0 in 0.517s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:05:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-c4aa7b0d-a3d3-400f-a9f2-e3872c8a57b1 req-000cdece-74bc-443f-902f-bfa42e91c5ab tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.575s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:05:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-c4aa7b0d-a3d3-400f-a9f2-e3872c8a57b1 req-000cdece-74bc-443f-902f-bfa42e91c5ab tempest-TestServerVolumeAttachmentScenario-2057656121 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fdc2dbf9-a37f-47d7-a341-afcac29e62a6', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 14:05:57 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-c4aa7b0d-a3d3-400f-a9f2-e3872c8a57b1 req-000cdece-74bc-443f-902f-bfa42e91c5ab tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:05:57 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-c4aa7b0d-a3d3-400f-a9f2-e3872c8a57b1 req-000cdece-74bc-443f-902f-bfa42e91c5ab tempest-TestServerVolumeAttachmentScenario-2057656121 None] attachment_update completed successfully.
Sep 10 14:06:01 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:06:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:06:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:06:01 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a62622-641a-423a-adb2-93b8495161e6]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:06:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:06:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090" returned: 0 in 0.446s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:06:02 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[b431c18d-9c6f-44e8-ac77-21ea467b5038]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:06:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:06:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090" returned: 0 in 0.499s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:06:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 /opt/stack/data/cinder/conversion/3e897af2-fb12-4dd1-9560-b0efa76fd090.temp_image.0d0659c6-ae2f-4ba5-90ef-832e8ab64157e5va7mju.img {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:06:07 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=16,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:06:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 /opt/stack/data/cinder/conversion/3e897af2-fb12-4dd1-9560-b0efa76fd090.temp_image.0d0659c6-ae2f-4ba5-90ef-832e8ab64157e5va7mju.img" returned: 0 in 8.737s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:06:11 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[0317d027-96fd-45f3-8f5f-7d4bdb4527ff]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:06:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:06:11 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=21,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:06:12 devstack quobyte-client[82845]: System call of process 97497 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:06:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090" returned: 0 in 0.714s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:06:12 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090, size 1024.00 MB, duration 8.74 sec, destination /opt/stack/data/cinder/conversion/3e897af2-fb12-4dd1-9560-b0efa76fd090.temp_image.0d0659c6-ae2f-4ba5-90ef-832e8ab64157e5va7mju.img {{(pid=82823) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 14:06:12 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] Converted 1024.00 MB image at 117.11 MB/s
Sep 10 14:06:12 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] 0d0659c6-ae2f-4ba5-90ef-832e8ab64157 was raw, no need to convert to raw {{(pid=82823) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 10 14:06:22 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:06:26 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-892578ff-6b98-4374-a9a5-e152e648aff3 req-a98a3411-b7eb-4c5f-b82b-ccc0075ce6de tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:06:26 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-892578ff-6b98-4374-a9a5-e152e648aff3 req-a98a3411-b7eb-4c5f-b82b-ccc0075ce6de tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:06:26 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-892578ff-6b98-4374-a9a5-e152e648aff3 req-a98a3411-b7eb-4c5f-b82b-ccc0075ce6de tempest-TestServerVolumeAttachmentScenario-2057656121 None] Terminate volume connection completed successfully.
Sep 10 14:06:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-892578ff-6b98-4374-a9a5-e152e648aff3 req-a98a3411-b7eb-4c5f-b82b-ccc0075ce6de tempest-TestServerVolumeAttachmentScenario-2057656121 None] Deleting attachment fdc2dbf9-a37f-47d7-a341-afcac29e62a6. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 14:06:36 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:06:36 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:06:51 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-2ab03aea-703f-4f51-97d0-e4a05aa58c3b req-4025ce40-e8fe-47a8-90bc-6eeee3dc2007 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:06:51 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-2ab03aea-703f-4f51-97d0-e4a05aa58c3b req-4025ce40-e8fe-47a8-90bc-6eeee3dc2007 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:06:51 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-2ab03aea-703f-4f51-97d0-e4a05aa58c3b req-4025ce40-e8fe-47a8-90bc-6eeee3dc2007 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Terminate volume connection completed successfully.
Sep 10 14:06:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-2ab03aea-703f-4f51-97d0-e4a05aa58c3b req-4025ce40-e8fe-47a8-90bc-6eeee3dc2007 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Deleting attachment 29f3c7f3-f57f-485b-bfd6-1f740442f1e8. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 14:06:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 53.341s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:06:54 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] Uploaded volume to glance image-id: 0d0659c6-ae2f-4ba5-90ef-832e8ab64157. {{(pid=82823) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 10 14:06:55 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b120cf77-db13-4e69-beda-45ef44f7b113 tempest-VolumesActionsTest-926807224 None] Copy volume to image completed successfully.
Sep 10 14:06:56 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:06:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:06:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:06:56 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b43db2-d8fd-4a77-98f1-5edc870b9330]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:06:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:06:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090" returned: 0 in 0.472s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:06:56 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[0824b9e5-bb06-4d5d-bfa7-bb406780e6b8]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:06:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:06:57 devstack quobyte-client[82845]: System call of process 97564 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:06:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090" returned: 0 in 0.506s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:06:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 /opt/stack/data/cinder/conversion/3e897af2-fb12-4dd1-9560-b0efa76fd090.temp_image.494275af-9c39-4b1d-90c7-100002eaac6b7ntyfnvq.img {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 /opt/stack/data/cinder/conversion/3e897af2-fb12-4dd1-9560-b0efa76fd090.temp_image.494275af-9c39-4b1d-90c7-100002eaac6b7ntyfnvq.img" returned: 0 in 7.421s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:04 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c124ed-5f59-4392-ae82-b1e83b6d4a53]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:07:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:05 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:07:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090" returned: 0 in 0.972s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:05 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090, size 1024.00 MB, duration 7.44 sec, destination /opt/stack/data/cinder/conversion/3e897af2-fb12-4dd1-9560-b0efa76fd090.temp_image.494275af-9c39-4b1d-90c7-100002eaac6b7ntyfnvq.img {{(pid=82823) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 14:07:05 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Converted 1024.00 MB image at 137.59 MB/s
Sep 10 14:07:05 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] 494275af-9c39-4b1d-90c7-100002eaac6b was raw, converting to qcow2 {{(pid=82823) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 10 14:07:05 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d0513c-377f-4054-8fa0-3609f01314eb]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:07:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3e897af2-fb12-4dd1-9560-b0efa76fd090.temp_image.494275af-9c39-4b1d-90c7-100002eaac6b7ntyfnvq.img {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:06 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:07:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3e897af2-fb12-4dd1-9560-b0efa76fd090.temp_image.494275af-9c39-4b1d-90c7-100002eaac6b7ntyfnvq.img" returned: 0 in 0.560s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3e897af2-fb12-4dd1-9560-b0efa76fd090.temp_image.494275af-9c39-4b1d-90c7-100002eaac6b7ntyfnvq.img {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3e897af2-fb12-4dd1-9560-b0efa76fd090.temp_image.494275af-9c39-4b1d-90c7-100002eaac6b7ntyfnvq.img" returned: 1 in 0.516s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3e897af2-fb12-4dd1-9560-b0efa76fd090.temp_image.494275af-9c39-4b1d-90c7-100002eaac6b7ntyfnvq.img' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:07:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3e897af2-fb12-4dd1-9560-b0efa76fd090.temp_image.494275af-9c39-4b1d-90c7-100002eaac6b7ntyfnvq.img /opt/stack/data/cinder/conversion/vol_upload_pqczpwgk {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3e897af2-fb12-4dd1-9560-b0efa76fd090.temp_image.494275af-9c39-4b1d-90c7-100002eaac6b7ntyfnvq.img /opt/stack/data/cinder/conversion/vol_upload_pqczpwgk" returned: 0 in 0.174s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:07 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Image conversion details: src /opt/stack/data/cinder/conversion/3e897af2-fb12-4dd1-9560-b0efa76fd090.temp_image.494275af-9c39-4b1d-90c7-100002eaac6b7ntyfnvq.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_pqczpwgk {{(pid=82823) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 14:07:07 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 10 14:07:07 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3dddc8-7563-4872-98f0-7276a8d60d0e]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:07:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pqczpwgk {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pqczpwgk" returned: 0 in 0.334s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.967s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:07:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Uploaded volume to glance image-id: 494275af-9c39-4b1d-90c7-100002eaac6b. {{(pid=82823) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 10 14:07:09 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-64f4822f-8290-483c-b849-210097d6220d tempest-VolumesActionsTest-926807224 None] Copy volume to image completed successfully.
Sep 10 14:07:11 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Acquiring lock "cinder-3e897af2-fb12-4dd1-9560-b0efa76fd090-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:07:11 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Lock "cinder-3e897af2-fb12-4dd1-9560-b0efa76fd090-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:07:11 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:07:11 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Acquiring lock "cinder-quobyte-3e897af2-fb12-4dd1-9560-b0efa76fd090" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:07:11 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Lock "cinder-quobyte-3e897af2-fb12-4dd1-9560-b0efa76fd090" acquired by "delete_volume" :: waited 0.012s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:07:11 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86da281-28b2-4c24-bdac-54655818e80b]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:07:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090" returned: 0 in 0.499s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:12 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3e897af2-fb12-4dd1-9560-b0efa76fd090" returned: 0 in 0.113s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:12 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Lock "cinder-quobyte-3e897af2-fb12-4dd1-9560-b0efa76fd090" released by "delete_volume" :: held 0.783s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:07:12 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Created reservations ['9b6f2e94-834b-4db0-bc92-e7572326425e', 'bbb4797b-cdba-4090-8ecf-a92e529413c1', 'fd90cd37-17e3-401c-b513-fe45f1e48296', '7b24ab0d-4e79-4847-93b1-a5924843a39e'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:07:12 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Acquiring lock "cinder-b7637446-cabe-43c0-8ba9-db0ef55a4c10-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:07:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "cinder-b7637446-cabe-43c0-8ba9-db0ef55a4c10-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:07:13 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:07:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Acquiring lock "cinder-quobyte-b7637446-cabe-43c0-8ba9-db0ef55a4c10" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:07:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:07:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:07:13 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:07:13 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:07:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:07:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.176s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:13 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:07:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "cinder-quobyte-b7637446-cabe-43c0-8ba9-db0ef55a4c10" acquired by "delete_volume" :: waited 0.254s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:07:13 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Deleted volume successfully.
Sep 10 14:07:13 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[8153568c-b2cd-469b-8efb-14609fe37e3d]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:07:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:13 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0711c73f-6d11-4aa8-a897-32dea8bc98ad tempest-VolumesActionsTest-926807224 None] Lock "cinder-3e897af2-fb12-4dd1-9560-b0efa76fd090-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:07:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10" returned: 0 in 0.486s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b7637446-cabe-43c0-8ba9-db0ef55a4c10" returned: 0 in 0.102s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:14 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "cinder-quobyte-b7637446-cabe-43c0-8ba9-db0ef55a4c10" released by "delete_volume" :: held 0.826s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:07:14 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Created reservations ['4babe0c6-f3ba-492c-88f1-060257a45351', '54a5332e-b8de-4535-bc05-8c757e5e6315', '2dfd0ad6-db93-422f-841f-27cc0aaee59f', '1885543e-9535-452e-96a4-d1121b6cf087'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:07:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:07:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:07:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:07:14 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:07:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:07:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.145s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:14 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:07:14 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Deleted volume successfully.
Sep 10 14:07:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d8264c44-d0f0-49b6-83f7-08b179249689 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "cinder-b7637446-cabe-43c0-8ba9-db0ef55a4c10-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:07:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Acquiring lock "cinder-f50025e2-9885-404d-9e44-56c4e3dd98e3-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:07:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "cinder-f50025e2-9885-404d-9e44-56c4e3dd98e3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:07:15 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:07:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Acquiring lock "cinder-quobyte-f50025e2-9885-404d-9e44-56c4e3dd98e3" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:07:15 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "cinder-quobyte-f50025e2-9885-404d-9e44-56c4e3dd98e3" acquired by "delete_volume" :: waited 0.015s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:07:15 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[f273f5b4-4d68-4a90-844d-4631739ae129]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:07:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f50025e2-9885-404d-9e44-56c4e3dd98e3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f50025e2-9885-404d-9e44-56c4e3dd98e3" returned: 0 in 0.616s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f50025e2-9885-404d-9e44-56c4e3dd98e3 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f50025e2-9885-404d-9e44-56c4e3dd98e3" returned: 0 in 0.134s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:16 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "cinder-quobyte-f50025e2-9885-404d-9e44-56c4e3dd98e3" released by "delete_volume" :: held 0.943s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:07:16 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Created reservations ['1ac78d48-deb0-4e8a-9d24-42db19d7287b', 'd074bd67-c627-4415-aeeb-4f370c33182e', '436e9989-3cf2-4aa1-98cf-df1bc03fefd9', '100c46a1-4869-4329-a109-32d34f8368a9'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:07:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:07:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:07:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:07:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:07:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:07:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.103s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:17 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:07:17 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Deleted volume successfully.
Sep 10 14:07:17 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3c8b02d1-6820-4bba-af85-0eb9c23c9936 tempest-TestServerVolumeAttachmentScenario-2057656121 None] Lock "cinder-f50025e2-9885-404d-9e44-56c4e3dd98e3-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:07:23 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Flow 'volume_create_manager' (2ea1d2ab-bfd2-4cbd-83b8-417ef616185e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75442ae4-dc7f-43dd-bf41-2486c768d567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75442ae4-dc7f-43dd-bf41-2486c768d567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1318241942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b503ab77-2eb4-4eb5-b331-7d3a71d0fb34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4da847f75d245e98f7083da8522524d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:07:23Z,use_quota=True,user_id='c09f788272a4434995a74ce3c7ee7d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23df10cf-7974-42da-a3bd-7348b5fcebad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23df10cf-7974-42da-a3bd-7348b5fcebad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6affad22-fe3f-4f2a-be4d-500e6688fb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6affad22-fe3f-4f2a-be4d-500e6688fb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b503ab77-2eb4-4eb5-b331-7d3a71d0fb34', 'volume_name': 'volume-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58db26d8-3d8e-435c-8223-6b96ba518deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58db26d8-3d8e-435c-8223-6b96ba518deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a874c42-6aff-4e52-9615-2a0a51d6359e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:07:23 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Volume b503ab77-2eb4-4eb5-b331-7d3a71d0fb34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34', 'volume_size': 1}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1318241942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b503ab77-2eb4-4eb5-b331-7d3a71d0fb34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4da847f75d245e98f7083da8522524d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:07:23Z,use_quota=True,user_id='c09f788272a4434995a74ce3c7ee7d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Creating volume b503ab77-2eb4-4eb5-b331-7d3a71d0fb34 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:07:23 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:07:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:23 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=123, name=volume-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:07:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34 1073741824" returned: 0 in 0.450s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34" returned: 0 in 0.168s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] <== create_volume: return (703ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:07:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:07:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a874c42-6aff-4e52-9615-2a0a51d6359e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:07:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ec893f-c06b-4ec4-a800-cf879bcf2090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:07:24 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Volume volume-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34 (b503ab77-2eb4-4eb5-b331-7d3a71d0fb34): created successfully
Sep 10 14:07:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ec893f-c06b-4ec4-a800-cf879bcf2090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:07:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Flow 'volume_create_manager' (2ea1d2ab-bfd2-4cbd-83b8-417ef616185e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:07:24 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-048e45ae-4053-447d-b59a-d6b0e6310cf2 tempest-VolumesNegativeTest-1789764168 None] Created volume successfully.
Sep 10 14:07:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 14:07:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:07:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:07:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:07:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:07:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:07:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:07:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.158s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:07:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:07:34 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=13,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=3 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:07:34 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=22,cinder:UPDATE=29,cinder:INSERT=5,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:08:07 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:08:10 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:08:10 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:08:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Flow 'volume_create_manager' (313e958c-4de0-4715-b957-d43f9c38e477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:08:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7037c4d7-afa3-4df7-9be3-948605042556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:08:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7037c4d7-afa3-4df7-9be3-948605042556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1085970169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ab923f-83ff-43e1-97ba-1b0cbceff187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766d5ad86e6f4f99a0d11be744815301',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:08:10Z,use_quota=True,user_id='610b48740826422b95dba283d1f0a89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:08:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd05fa8-00cd-4814-810f-a6a8f6d9e790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:08:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd05fa8-00cd-4814-810f-a6a8f6d9e790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:08:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a234b7c7-4c60-49d5-bb20-4ff81b98b6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:08:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a234b7c7-4c60-49d5-bb20-4ff81b98b6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '40ab923f-83ff-43e1-97ba-1b0cbceff187', 'volume_name': 'volume-40ab923f-83ff-43e1-97ba-1b0cbceff187', 'volume_size': 1, 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02b5bb39d7434620bf21786ff3aad29c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'created_at': datetime.datetime(2025, 9, 10, 11, 23, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 23, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f8481a-df2c-4f8b-8548-87d289ce329e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b5704df0>}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:08:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91077f04-6dba-4e8b-97e3-848ea7bc8fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:08:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91077f04-6dba-4e8b-97e3-848ea7bc8fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:08:10 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c91980e0-f5df-4367-8fe0-96bd5b3416a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:08:10 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Volume 40ab923f-83ff-43e1-97ba-1b0cbceff187: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-40ab923f-83ff-43e1-97ba-1b0cbceff187', 'volume_size': 1, 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02b5bb39d7434620bf21786ff3aad29c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'created_at': datetime.datetime(2025, 9, 10, 11, 23, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 23, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f8481a-df2c-4f8b-8548-87d289ce329e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b5704df0>}
Sep 10 14:08:10 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Cloning 40ab923f-83ff-43e1-97ba-1b0cbceff187 from image b4f8481a-df2c-4f8b-8548-87d289ce329e  at location (None, None). {{(pid=82823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 14:08:11 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_jmw5vo5fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 14:08:11 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Image download 20.69 MB at 20.69 MB/s
Sep 10 14:08:11 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdcfbf5-044f-4b97-9efd-31f37b7f756d]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_jmw5vo5fdevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:11 devstack sudo[97888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_jmw5vo5fdevstack@QuobyteHD
Sep 10 14:08:11 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 14:08:13 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root
Sep 10 14:08:13 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_jmw5vo5fdevstack@QuobyteHD" returned: 0 in 2.636s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:13 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Temporary image b4f8481a-df2c-4f8b-8548-87d289ce329e is fetched for user 610b48740826422b95dba283d1f0a89b. {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 14:08:14 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[f632577d-330c-4597-b416-9799826a78eb]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_jmw5vo5fdevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:14 devstack sudo[97895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_jmw5vo5fdevstack@QuobyteHD
Sep 10 14:08:14 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 14:08:16 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root
Sep 10 14:08:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_jmw5vo5fdevstack@QuobyteHD" returned: 0 in 2.302s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:08:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:08:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1085970169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ab923f-83ff-43e1-97ba-1b0cbceff187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766d5ad86e6f4f99a0d11be744815301',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:08:10Z,use_quota=True,user_id='610b48740826422b95dba283d1f0a89b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:08:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Creating volume 40ab923f-83ff-43e1-97ba-1b0cbceff187 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:08:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:08:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:08:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:08:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:08:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:08:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:08:16 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:08:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:16 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=124, name=volume-40ab923f-83ff-43e1-97ba-1b0cbceff187, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:08:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 1073741824" returned: 0 in 0.378s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187" returned: 0 in 0.135s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:17 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] <== create_volume: return (660ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:08:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:08:17 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Attempting download of b4f8481a-df2c-4f8b-8548-87d289ce329e ((None, None)) to volume 40ab923f-83ff-43e1-97ba-1b0cbceff187. {{(pid=82823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 14:08:17 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f502abc-30c4-4182-bf95-38ee3de4c70e]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_2nu0lag2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_2nu0lag2" returned: 0 in 0.550s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_2nu0lag2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:18 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Acquiring lock "cinder-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:08:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_2nu0lag2" returned: 1 in 0.811s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4f8481a-df2c-4f8b-8548-87d289ce329e_2nu0lag2' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:08:19 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Lock "cinder-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:08:19 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4b2162-3842-4e76-9f86-f03033d73b2f]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_jmw5vo5fdevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:19 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:08:19 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Acquiring lock "cinder-quobyte-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:08:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_jmw5vo5fdevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:19 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] b4f8481a-df2c-4f8b-8548-87d289ce329e was qcow2, converting to raw {{(pid=82823) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 14:08:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_jmw5vo5fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:19 devstack quobyte-client[82845]: System call of process 97914 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:08:19 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=124, name=volume-40ab923f-83ff-43e1-97ba-1b0cbceff187, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:08:19 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Lock "cinder-quobyte-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34" acquired by "delete_volume" :: waited 0.183s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:08:19 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[801cb9a8-ad38-4464-b11f-e766185fb3fe]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34" returned: 0 in 0.566s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34" returned: 0 in 0.143s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Lock "cinder-quobyte-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34" released by "delete_volume" :: held 1.020s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:08:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_jmw5vo5fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187" returned: 0 in 1.490s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:21 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4f8481a-df2c-4f8b-8548-87d289ce329e_jmw5vo5fdevstack@QuobyteHD, size 112.00 MB, duration 1.49 sec, destination /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 {{(pid=82823) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 14:08:21 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Converted 112.00 MB image at 74.95 MB/s
Sep 10 14:08:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:21 devstack quobyte-client[82845]: System call of process 97953 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:08:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 1G" returned: 0 in 0.448s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:21 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Created reservations ['fa3b53d9-9ea8-4707-9728-d62faccf593d', 'a0850433-c5e3-4cb0-b84f-fc8f654ee326', '1a06f873-966c-4a15-9789-6f9987801f53', 'e8d5c96e-9187-4495-bcee-087f383a886d'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:08:21 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c37564-8866-4c1c-bf78-b03b19f8f9a5]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187" returned: 0 in 0.627s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.209s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:08:22 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Deleted volume successfully.
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0823c288-5de2-4798-aaf7-cc07b51a6d29 tempest-VolumesNegativeTest-1789764168 None] Lock "cinder-b503ab77-2eb4-4eb5-b331-7d3a71d0fb34-delete_volume" released by "delete_volume" :: held 3.814s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187" returned: 1 in 0.517s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Downloaded image b4f8481a-df2c-4f8b-8548-87d289ce329e ((None, None)) to volume 40ab923f-83ff-43e1-97ba-1b0cbceff187 successfully. {{(pid=82823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Temporary image b4f8481a-df2c-4f8b-8548-87d289ce329e for user 610b48740826422b95dba283d1f0a89b is deleted. {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 14:08:22 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Marking volume 40ab923f-83ff-43e1-97ba-1b0cbceff187 as bootable. {{(pid=82823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 14:08:23 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Copying metadata from image b4f8481a-df2c-4f8b-8548-87d289ce329e to 40ab923f-83ff-43e1-97ba-1b0cbceff187. {{(pid=82823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 14:08:23 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Creating volume glance metadata for volume 40ab923f-83ff-43e1-97ba-1b0cbceff187 backed by image b4f8481a-df2c-4f8b-8548-87d289ce329e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 14:08:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c91980e0-f5df-4367-8fe0-96bd5b3416a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40ab923f-83ff-43e1-97ba-1b0cbceff187', 'volume_size': 1, 'image_id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '02b5bb39d7434620bf21786ff3aad29c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b4f8481a-df2c-4f8b-8548-87d289ce329e', 'created_at': datetime.datetime(2025, 9, 10, 11, 23, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 11, 23, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4f8481a-df2c-4f8b-8548-87d289ce329e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b5704df0>}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:08:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced0d062-15a2-458c-b16f-c31aa206f545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:08:23 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Volume volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 (40ab923f-83ff-43e1-97ba-1b0cbceff187): created successfully
Sep 10 14:08:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced0d062-15a2-458c-b16f-c31aa206f545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:08:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Flow 'volume_create_manager' (313e958c-4de0-4715-b957-d43f9c38e477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:08:23 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b93c129f-5094-4ef3-b6c9-cd3a98821a8a tempest-TestShelveInstance-177777330 None] Created volume successfully.
Sep 10 14:08:25 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Flow 'volume_create_manager' (e77f8bb0-c93f-4f4d-8532-23c79272a5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a05372-77f3-4141-a8d2-6806154080a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a05372-77f3-4141-a8d2-6806154080a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-375951553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505af2d2-faf3-4a61-933c-f2d64cb38bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7e052d9ab8c45629ec80de439931fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:08:25Z,use_quota=True,user_id='e5476b5960bb451ca8ad10381e983fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2e3be7-3dc0-464f-a320-c7615330bd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2e3be7-3dc0-464f-a320-c7615330bd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3703bb41-8fb5-488a-9079-79f12573c3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3703bb41-8fb5-488a-9079-79f12573c3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '505af2d2-faf3-4a61-933c-f2d64cb38bc2', 'volume_name': 'volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bc3276-ba56-431d-ab07-f4a66b787c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94bc3276-ba56-431d-ab07-f4a66b787c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1fd449-2a8c-45b3-93c0-6d7aa58cb79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:08:25 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Volume 505af2d2-faf3-4a61-933c-f2d64cb38bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2', 'volume_size': 1}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-375951553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505af2d2-faf3-4a61-933c-f2d64cb38bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7e052d9ab8c45629ec80de439931fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:08:25Z,use_quota=True,user_id='e5476b5960bb451ca8ad10381e983fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Creating volume 505af2d2-faf3-4a61-933c-f2d64cb38bc2 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:08:25 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:25 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=125, name=volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2 1073741824" returned: 0 in 0.397s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2" returned: 0 in 0.115s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] <== create_volume: return (582ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:08:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.591s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:08:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1fd449-2a8c-45b3-93c0-6d7aa58cb79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:08:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46eda513-2f76-4d9d-8d67-8bb5d487365b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:08:26 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Volume volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2 (505af2d2-faf3-4a61-933c-f2d64cb38bc2): created successfully
Sep 10 14:08:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46eda513-2f76-4d9d-8d67-8bb5d487365b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:08:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Flow 'volume_create_manager' (e77f8bb0-c93f-4f4d-8532-23c79272a5be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:08:26 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-41c463e7-dc88-4fd6-88e3-b5eea44db6eb tempest-VolumesSnapshotListTestJSON-1138310212 None] Created volume successfully.
Sep 10 14:08:27 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:08:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:08:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:08:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] Creating offline snapshot e4008ae3-2fa3-4eb8-8445-29101fcca976 of volume 505af2d2-faf3-4a61-933c-f2d64cb38bc2 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:08:27 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d4435c-a7b4-4039-809d-2505faf24642]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2" returned: 0 in 0.456s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:28 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=126, name=volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:08:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 1G" returned: 0 in 0.230s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): qemu-img rebase -u -b volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "qemu-img rebase -u -b volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976" returned: 0 in 0.151s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:08:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976" returned: 0 in 0.084s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:08:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976" returned: 0 in 0.137s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.info" returned: 0 in 0.087s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:08:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.info" returned: 0 in 0.100s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.580s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:08:29 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-196b8ed2-542b-4707-9d4f-40aa3b498e3e tempest-VolumesSnapshotListTestJSON-1138310212 None] Create snapshot completed successfully
Sep 10 14:08:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 14:08:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:08:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:08:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:08:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:08:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:08:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.105s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:08:34 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:08:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:08:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:08:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] Creating offline snapshot b7574f3d-dc1c-4e51-92aa-d82a845eae76 of volume 505af2d2-faf3-4a61-933c-f2d64cb38bc2 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:08:34 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[882352c1-ca1d-4a2b-a2ab-9a1a45e2cc6a]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:35 devstack quobyte-client[82845]: System call of process 97990 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:08:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976" returned: 0 in 0.542s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:35 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:08:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:35 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=128, name=volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:08:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 1G" returned: 0 in 0.385s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): qemu-img rebase -u -b volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "qemu-img rebase -u -b volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76" returned: 0 in 0.201s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:08:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76" returned: 0 in 0.232s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:08:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76" returned: 0 in 0.088s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.845s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:08:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-1834b870-d1c8-42fc-9d6a-ea61d6842baf req-5746458e-da66-4109-91e1-9e1c9d24ae7a tempest-TestShelveInstance-177777330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:08:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-1834b870-d1c8-42fc-9d6a-ea61d6842baf req-5746458e-da66-4109-91e1-9e1c9d24ae7a tempest-TestShelveInstance-177777330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:08:37 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c6d478-bd18-4c39-83cf-4d1be2c5ae34]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-1834b870-d1c8-42fc-9d6a-ea61d6842baf req-5746458e-da66-4109-91e1-9e1c9d24ae7a tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:37 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-e3d6cd9d-254f-4dba-874a-5d6e53c28004 tempest-VolumesSnapshotListTestJSON-1138310212 None] Create snapshot completed successfully
Sep 10 14:08:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-1834b870-d1c8-42fc-9d6a-ea61d6842baf req-5746458e-da66-4109-91e1-9e1c9d24ae7a tempest-TestShelveInstance-177777330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187" returned: 0 in 0.485s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-1834b870-d1c8-42fc-9d6a-ea61d6842baf req-5746458e-da66-4109-91e1-9e1c9d24ae7a tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-1834b870-d1c8-42fc-9d6a-ea61d6842baf req-5746458e-da66-4109-91e1-9e1c9d24ae7a tempest-TestShelveInstance-177777330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187" returned: 1 in 0.436s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-1834b870-d1c8-42fc-9d6a-ea61d6842baf req-5746458e-da66-4109-91e1-9e1c9d24ae7a tempest-TestShelveInstance-177777330 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:08:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-1834b870-d1c8-42fc-9d6a-ea61d6842baf req-5746458e-da66-4109-91e1-9e1c9d24ae7a tempest-TestShelveInstance-177777330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:08:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-1834b870-d1c8-42fc-9d6a-ea61d6842baf req-5746458e-da66-4109-91e1-9e1c9d24ae7a tempest-TestShelveInstance-177777330 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-40ab923f-83ff-43e1-97ba-1b0cbceff187', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b85a9c1-cbb1-4e37-9693-c93a151f1d8c', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 14:08:39 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-1834b870-d1c8-42fc-9d6a-ea61d6842baf req-5746458e-da66-4109-91e1-9e1c9d24ae7a tempest-TestShelveInstance-177777330 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:08:39 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-1834b870-d1c8-42fc-9d6a-ea61d6842baf req-5746458e-da66-4109-91e1-9e1c9d24ae7a tempest-TestShelveInstance-177777330 None] attachment_update completed successfully.
Sep 10 14:08:39 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:08:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:08:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:08:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] Creating offline snapshot 8529beb8-9c54-4fbe-b6f7-af9a6de832fc of volume 505af2d2-faf3-4a61-933c-f2d64cb38bc2 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:08:39 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[30227366-9082-4b62-b5dd-cbe9c5edba12]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:40 devstack quobyte-client[82845]: System call of process 98014 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:08:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76" returned: 0 in 0.515s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:08:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:40 devstack quobyte-client[82845]: System call of process 98017 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:08:40 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=129, name=volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:08:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc 1G" returned: 0 in 0.480s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): qemu-img rebase -u -b volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:41 devstack quobyte-client[82845]: System call of process 98021 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:08:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "qemu-img rebase -u -b volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc" returned: 0 in 0.264s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:08:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc" returned: 0 in 0.117s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:08:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc" returned: 0 in 0.087s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.758s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:08:42 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a5b8a458-83d2-4c27-a5ec-15cda0feb1e5 tempest-VolumesSnapshotListTestJSON-1138310212 None] Create snapshot completed successfully
Sep 10 14:08:44 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "cinder-8529beb8-9c54-4fbe-b6f7-af9a6de832fc-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:08:44 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-8529beb8-9c54-4fbe-b6f7-af9a6de832fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.088s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:08:44 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:08:44 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "cinder-quobyte-505af2d2-faf3-4a61-933c-f2d64cb38bc2" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:08:44 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-quobyte-505af2d2-faf3-4a61-933c-f2d64cb38bc2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:08:44 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "cinder-quobyte-8529beb8-9c54-4fbe-b6f7-af9a6de832fc" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:08:44 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-quobyte-8529beb8-9c54-4fbe-b6f7-af9a6de832fc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:08:44 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Deleting offline snapshot 8529beb8-9c54-4fbe-b6f7-af9a6de832fc of volume 505af2d2-faf3-4a61-933c-f2d64cb38bc2 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:08:44 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] snapshot_file for this snap is: volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:08:44 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de5e259-2469-4014-81e0-9e8b49c032c1]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc" returned: 0 in 0.525s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:08:45 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3153db-4ab9-4983-8597-764c58ee4f17]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:45 devstack quobyte-client[82845]: System call of process 98094 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:08:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76" returned: 0 in 0.568s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:08:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc" returned: 0 in 0.318s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.8529beb8-9c54-4fbe-b6f7-af9a6de832fc" returned: 0 in 0.091s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-quobyte-8529beb8-9c54-4fbe-b6f7-af9a6de832fc" released by "_delete_snapshot" :: held 1.869s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:08:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-quobyte-505af2d2-faf3-4a61-933c-f2d64cb38bc2" released by "delete_snapshot" :: held 1.903s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:08:46 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Created reservations ['5941fc1e-f0ad-4559-ac33-a84d882d9a2b', 'c7a935f7-7dee-4217-a2b5-1296ea689e2c', 'd79de3f9-9c9c-4675-ae34-d70810478908', '59705689-efe8-44a2-9a4d-d636cce2f210'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:08:47 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Delete snapshot completed successfully.
Sep 10 14:08:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-92347a7f-b930-42a1-a422-e34f6b7ada76 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-8529beb8-9c54-4fbe-b6f7-af9a6de832fc-delete_snapshot" released by "delete_snapshot" :: held 3.274s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:08:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "cinder-b7574f3d-dc1c-4e51-92aa-d82a845eae76-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:08:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-b7574f3d-dc1c-4e51-92aa-d82a845eae76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:08:47 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:08:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "cinder-quobyte-505af2d2-faf3-4a61-933c-f2d64cb38bc2" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:08:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-quobyte-505af2d2-faf3-4a61-933c-f2d64cb38bc2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:08:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "cinder-quobyte-b7574f3d-dc1c-4e51-92aa-d82a845eae76" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:08:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-quobyte-b7574f3d-dc1c-4e51-92aa-d82a845eae76" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:08:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Deleting offline snapshot b7574f3d-dc1c-4e51-92aa-d82a845eae76 of volume 505af2d2-faf3-4a61-933c-f2d64cb38bc2 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:08:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] snapshot_file for this snap is: volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:08:47 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e8b1ba-0347-40a8-a33f-e79bc9ec0e35]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76" returned: 0 in 0.477s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:08:48 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ad0089-c897-4bab-bf13-ecb6a4ec0fb5]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976" returned: 0 in 0.461s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:08:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76" returned: 0 in 0.275s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.b7574f3d-dc1c-4e51-92aa-d82a845eae76" returned: 0 in 0.160s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-quobyte-b7574f3d-dc1c-4e51-92aa-d82a845eae76" released by "_delete_snapshot" :: held 1.721s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:08:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-quobyte-505af2d2-faf3-4a61-933c-f2d64cb38bc2" released by "delete_snapshot" :: held 1.774s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:08:50 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Created reservations ['b1705538-0a01-454f-a652-faa7d52832f7', 'c8e2bb53-d0e8-4776-a881-d340ec071ab4', '99b347a8-58ab-4c12-9955-6774a854a85f', 'b2f92f8c-3591-4628-b251-5b5ae39b51dd'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:08:51 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Delete snapshot completed successfully.
Sep 10 14:08:51 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-2b059c95-21ff-4851-b5f2-cd17094ce93c tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-b7574f3d-dc1c-4e51-92aa-d82a845eae76-delete_snapshot" released by "delete_snapshot" :: held 3.816s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:08:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "cinder-e4008ae3-2fa3-4eb8-8445-29101fcca976-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:08:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-e4008ae3-2fa3-4eb8-8445-29101fcca976-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:08:52 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:08:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "cinder-quobyte-505af2d2-faf3-4a61-933c-f2d64cb38bc2" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:08:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-quobyte-505af2d2-faf3-4a61-933c-f2d64cb38bc2" acquired by "delete_snapshot" :: waited 0.036s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:08:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "cinder-quobyte-e4008ae3-2fa3-4eb8-8445-29101fcca976" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:08:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-quobyte-e4008ae3-2fa3-4eb8-8445-29101fcca976" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:08:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Deleting offline snapshot e4008ae3-2fa3-4eb8-8445-29101fcca976 of volume 505af2d2-faf3-4a61-933c-f2d64cb38bc2 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:08:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] snapshot_file for this snap is: volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:08:52 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0cb8c9-4748-4a85-b13c-9a138a48746f]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976" returned: 0 in 0.728s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:08:53 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98f9141-2e66-4cd0-8930-90456d6c2a41]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:08:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:54 devstack quobyte-client[82845]: System call of process 98501 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:08:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2" returned: 0 in 0.809s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976" returned: 0 in 0.378s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:08:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2.e4008ae3-2fa3-4eb8-8445-29101fcca976" returned: 0 in 0.150s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:08:55 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-quobyte-e4008ae3-2fa3-4eb8-8445-29101fcca976" released by "_delete_snapshot" :: held 2.821s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:08:55 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-quobyte-505af2d2-faf3-4a61-933c-f2d64cb38bc2" released by "delete_snapshot" :: held 2.864s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:08:58 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Created reservations ['bc942923-25dd-4bcf-aa99-e23f6ceed200', '1a347577-2147-434d-a828-210373ff533a', 'ac73f707-06a3-45a9-a5bc-15f50bfcc676', '43d66128-d60f-4e5c-a354-cdbd88c370c9'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:08:59 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Delete snapshot completed successfully.
Sep 10 14:08:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b417bcff-5c64-4e4a-9ecf-bdba2bef5554 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-e4008ae3-2fa3-4eb8-8445-29101fcca976-delete_snapshot" released by "delete_snapshot" :: held 6.954s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:09:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "cinder-505af2d2-faf3-4a61-933c-f2d64cb38bc2-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:09:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-505af2d2-faf3-4a61-933c-f2d64cb38bc2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:09:00 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:09:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "cinder-quobyte-505af2d2-faf3-4a61-933c-f2d64cb38bc2" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:09:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-quobyte-505af2d2-faf3-4a61-933c-f2d64cb38bc2" acquired by "delete_volume" :: waited 0.019s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:09:00 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfae6ef-ea5b-477c-a7b4-2652904543d2]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:09:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2" returned: 0 in 0.590s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-505af2d2-faf3-4a61-933c-f2d64cb38bc2" returned: 0 in 0.205s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-quobyte-505af2d2-faf3-4a61-933c-f2d64cb38bc2" released by "delete_volume" :: held 0.957s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:09:02 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Created reservations ['5a03b251-65ec-49f4-92c2-06a686f6851b', '322be972-739b-4c2f-9108-f6f1d28f07e7', 'f447de9d-3272-441d-b9bb-9852c062a266', 'dd169d0a-e0e6-45d2-bd16-894e2d98a976'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:09:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:04 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:09:04 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:09:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.171s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:04 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:09:04 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Deleted volume successfully.
Sep 10 14:09:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-61dc964d-e914-4cdd-bbef-982eaad452c2 tempest-VolumesSnapshotListTestJSON-1138310212 None] Lock "cinder-505af2d2-faf3-4a61-933c-f2d64cb38bc2-delete_volume" released by "delete_volume" :: held 4.497s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:09:13 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=45,cinder:SELECT=42,cinder:INSERT=24,cinder:DELETE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:09:14 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=44,cinder:UPDATE=41,cinder:INSERT=9,cinder:DELETE=5 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:09:14 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:09:14 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:09:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Flow 'volume_create_manager' (06ea4fc2-6495-4ae7-b9bf-e51fcec95f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:09:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e178f274-2836-4e97-a1ac-868fd0a59d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e178f274-2836-4e97-a1ac-868fd0a59d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1261549583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dc4f74-9018-4ef6-b2fe-50e5996ade73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785d015c0494975b3d541d3ffd020f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:09:14Z,use_quota=True,user_id='3c92bc3dbe45494980fb4bd70daecd72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e2dae3-d8f6-4940-8aeb-e4d0d8f88f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e2dae3-d8f6-4940-8aeb-e4d0d8f88f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d48db4-5307-4cf9-99e6-d4b05596f073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d48db4-5307-4cf9-99e6-d4b05596f073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9dc4f74-9018-4ef6-b2fe-50e5996ade73', 'volume_name': 'volume-b9dc4f74-9018-4ef6-b2fe-50e5996ade73', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46785b9-671a-4f41-b0ec-546c09b0c1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46785b9-671a-4f41-b0ec-546c09b0c1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12d4457-a3ca-4931-aad9-fe9193f0e301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:15 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume b9dc4f74-9018-4ef6-b2fe-50e5996ade73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9dc4f74-9018-4ef6-b2fe-50e5996ade73', 'volume_size': 1}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1261549583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dc4f74-9018-4ef6-b2fe-50e5996ade73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785d015c0494975b3d541d3ffd020f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:09:14Z,use_quota=True,user_id='3c92bc3dbe45494980fb4bd70daecd72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Creating volume b9dc4f74-9018-4ef6-b2fe-50e5996ade73 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:09:15 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9dc4f74-9018-4ef6-b2fe-50e5996ade73 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:15 devstack quobyte-client[82845]: System call of process 98556 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:09:15 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=130, name=volume-b9dc4f74-9018-4ef6-b2fe-50e5996ade73, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:09:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9dc4f74-9018-4ef6-b2fe-50e5996ade73 1073741824" returned: 0 in 0.647s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9dc4f74-9018-4ef6-b2fe-50e5996ade73 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9dc4f74-9018-4ef6-b2fe-50e5996ade73" returned: 0 in 0.127s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:16 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] <== create_volume: return (912ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:09:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12d4457-a3ca-4931-aad9-fe9193f0e301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9dc4f74-9018-4ef6-b2fe-50e5996ade73', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b62deb1-9e50-4c8b-85bd-43fde6449d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:16 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume volume-b9dc4f74-9018-4ef6-b2fe-50e5996ade73 (b9dc4f74-9018-4ef6-b2fe-50e5996ade73): created successfully
Sep 10 14:09:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b62deb1-9e50-4c8b-85bd-43fde6449d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Flow 'volume_create_manager' (06ea4fc2-6495-4ae7-b9bf-e51fcec95f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:09:17 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-e5ee59c8-8ce7-4e5c-9feb-b75860f675ce tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Created volume successfully.
Sep 10 14:09:19 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:09:19 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:09:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Flow 'volume_create_manager' (05e43197-678a-498f-9e89-df8408156efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:09:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625e9ff7-a636-4ce9-9ce2-cdc85b1e00b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625e9ff7-a636-4ce9-9ce2-cdc85b1e00b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1094133058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc56eae-8350-46d4-88c0-2c831ebefa60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785d015c0494975b3d541d3ffd020f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:09:19Z,use_quota=True,user_id='3c92bc3dbe45494980fb4bd70daecd72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c60d452-1468-4cb3-85e3-c8963c56b9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c60d452-1468-4cb3-85e3-c8963c56b9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7449d81b-1514-4387-a6aa-a246d7a9788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7449d81b-1514-4387-a6aa-a246d7a9788a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dc56eae-8350-46d4-88c0-2c831ebefa60', 'volume_name': 'volume-2dc56eae-8350-46d4-88c0-2c831ebefa60', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58fdf713-288d-45f8-b64d-91f34ff1bb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58fdf713-288d-45f8-b64d-91f34ff1bb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a77be14-f1df-4e00-9950-66006e551e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:20 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume 2dc56eae-8350-46d4-88c0-2c831ebefa60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dc56eae-8350-46d4-88c0-2c831ebefa60', 'volume_size': 1}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1094133058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc56eae-8350-46d4-88c0-2c831ebefa60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785d015c0494975b3d541d3ffd020f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:09:19Z,use_quota=True,user_id='3c92bc3dbe45494980fb4bd70daecd72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Creating volume 2dc56eae-8350-46d4-88c0-2c831ebefa60 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:09:20 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dc56eae-8350-46d4-88c0-2c831ebefa60 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:20 devstack quobyte-client[82845]: System call of process 98562 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:09:20 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=131, name=volume-2dc56eae-8350-46d4-88c0-2c831ebefa60, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dc56eae-8350-46d4-88c0-2c831ebefa60 1073741824" returned: 0 in 0.623s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dc56eae-8350-46d4-88c0-2c831ebefa60 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dc56eae-8350-46d4-88c0-2c831ebefa60" returned: 0 in 0.255s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] <== create_volume: return (936ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:09:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:21 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Flow 'volume_create_manager' (91f843dc-7ed7-4ae8-9c7a-e85339cd0383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d065a0dc-eb48-4f0c-9736-93d9fa33f405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a77be14-f1df-4e00-9950-66006e551e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc56eae-8350-46d4-88c0-2c831ebefa60', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c21067-5649-42f1-adfe-0cfe82c17378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d065a0dc-eb48-4f0c-9736-93d9fa33f405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1630300092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145be95e-4c70-4c29-848c-061cbcb2785f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785d015c0494975b3d541d3ffd020f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:09:20Z,use_quota=True,user_id='3c92bc3dbe45494980fb4bd70daecd72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f471cf8d-6a40-42ac-b1c6-1246f662e988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f471cf8d-6a40-42ac-b1c6-1246f662e988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480c98c8-bb9d-47b8-9a94-61682526a100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480c98c8-bb9d-47b8-9a94-61682526a100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '145be95e-4c70-4c29-848c-061cbcb2785f', 'volume_name': 'volume-145be95e-4c70-4c29-848c-061cbcb2785f', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd06ea48-9796-4a20-b93c-2d759e1662ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd06ea48-9796-4a20-b93c-2d759e1662ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6b60f0-4265-4d8f-8fcb-b2f689a1439d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:21 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume 145be95e-4c70-4c29-848c-061cbcb2785f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-145be95e-4c70-4c29-848c-061cbcb2785f', 'volume_size': 1}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1630300092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145be95e-4c70-4c29-848c-061cbcb2785f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785d015c0494975b3d541d3ffd020f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:09:20Z,use_quota=True,user_id='3c92bc3dbe45494980fb4bd70daecd72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Creating volume 145be95e-4c70-4c29-848c-061cbcb2785f {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:09:21 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:09:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-145be95e-4c70-4c29-848c-061cbcb2785f 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:21 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=132, name=volume-145be95e-4c70-4c29-848c-061cbcb2785f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:09:22 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume volume-2dc56eae-8350-46d4-88c0-2c831ebefa60 (2dc56eae-8350-46d4-88c0-2c831ebefa60): created successfully
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c21067-5649-42f1-adfe-0cfe82c17378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Flow 'volume_create_manager' (05e43197-678a-498f-9e89-df8408156efe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:09:22 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-ec3ce57a-67d0-4b1d-b9d1-68fe9c7fcad9 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Created volume successfully.
Sep 10 14:09:22 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Flow 'volume_create_manager' (c793193b-74e8-4363-a039-afc832e87a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e296afcc-0b0b-4f17-b52e-8489cf95d7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e296afcc-0b0b-4f17-b52e-8489cf95d7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1789708646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5cc475f-2a2f-410b-b91b-f1f2b3278977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785d015c0494975b3d541d3ffd020f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:09:22Z,use_quota=True,user_id='3c92bc3dbe45494980fb4bd70daecd72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9081a8-9457-4940-bef5-b3e593d0c40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9081a8-9457-4940-bef5-b3e593d0c40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddb8741-f4ab-41f6-9f9f-de35bb856ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddb8741-f4ab-41f6-9f9f-de35bb856ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5cc475f-2a2f-410b-b91b-f1f2b3278977', 'volume_name': 'volume-b5cc475f-2a2f-410b-b91b-f1f2b3278977', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89cf6e65-e898-4c90-bcb6-8b5c5f13e9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89cf6e65-e898-4c90-bcb6-8b5c5f13e9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19dc4c2-8f80-49ad-8189-1faf08be2d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:22 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume b5cc475f-2a2f-410b-b91b-f1f2b3278977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5cc475f-2a2f-410b-b91b-f1f2b3278977', 'volume_size': 1}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-145be95e-4c70-4c29-848c-061cbcb2785f 1073741824" returned: 0 in 0.931s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-145be95e-4c70-4c29-848c-061cbcb2785f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-145be95e-4c70-4c29-848c-061cbcb2785f" returned: 0 in 0.263s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] <== create_volume: return (1313ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:09:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1789708646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5cc475f-2a2f-410b-b91b-f1f2b3278977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785d015c0494975b3d541d3ffd020f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:09:22Z,use_quota=True,user_id='3c92bc3dbe45494980fb4bd70daecd72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:09:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Creating volume b5cc475f-2a2f-410b-b91b-f1f2b3278977 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:09:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:09:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:09:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.088s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:09:23 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:09:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b5cc475f-2a2f-410b-b91b-f1f2b3278977 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:23 devstack quobyte-client[82845]: System call of process 98600 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:09:23 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=133, name=volume-b5cc475f-2a2f-410b-b91b-f1f2b3278977, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6b60f0-4265-4d8f-8fcb-b2f689a1439d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-145be95e-4c70-4c29-848c-061cbcb2785f', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7d9a69-5cfe-4337-af74-20b312000c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b5cc475f-2a2f-410b-b91b-f1f2b3278977 1073741824" returned: 0 in 1.018s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b5cc475f-2a2f-410b-b91b-f1f2b3278977 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:24 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Flow 'volume_create_manager' (2272c84a-2f10-4657-a1a4-f251666363e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b47961c-4d14-4f19-9054-b2deed16d68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:24 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Flow 'volume_create_manager' (eae690f5-7c53-4957-8cbd-681cec9f43a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778bc1bf-6e8e-425e-b7ec-fe8e49fc6501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:24 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume volume-145be95e-4c70-4c29-848c-061cbcb2785f (145be95e-4c70-4c29-848c-061cbcb2785f): created successfully
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7d9a69-5cfe-4337-af74-20b312000c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Flow 'volume_create_manager' (91f843dc-7ed7-4ae8-9c7a-e85339cd0383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b47961c-4d14-4f19-9054-b2deed16d68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-441528866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8543a950-5b25-4a1d-90f0-ec7acb4836a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785d015c0494975b3d541d3ffd020f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:09:23Z,use_quota=True,user_id='3c92bc3dbe45494980fb4bd70daecd72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a5cc96-a90d-4ffc-96cf-b5d03ff2dad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a5cc96-a90d-4ffc-96cf-b5d03ff2dad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d910770-fadb-4abc-bb6e-b722272e46aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d910770-fadb-4abc-bb6e-b722272e46aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8543a950-5b25-4a1d-90f0-ec7acb4836a0', 'volume_name': 'volume-8543a950-5b25-4a1d-90f0-ec7acb4836a0', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57d134e-8292-43d5-9418-80f8e9965123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57d134e-8292-43d5-9418-80f8e9965123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142f159e-4364-4962-a130-011d5a0bba06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:24 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume 8543a950-5b25-4a1d-90f0-ec7acb4836a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8543a950-5b25-4a1d-90f0-ec7acb4836a0', 'volume_size': 1}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778bc1bf-6e8e-425e-b7ec-fe8e49fc6501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1181443180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce522c6-5df5-4db2-a44d-4bf0877fbc78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785d015c0494975b3d541d3ffd020f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:09:24Z,use_quota=True,user_id='3c92bc3dbe45494980fb4bd70daecd72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e784546-ffce-4a09-ac65-b4e3c8f6edad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e784546-ffce-4a09-ac65-b4e3c8f6edad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce6245d-9c4c-4bec-aa68-2f47e8a74d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce6245d-9c4c-4bec-aa68-2f47e8a74d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce522c6-5df5-4db2-a44d-4bf0877fbc78', 'volume_name': 'volume-3ce522c6-5df5-4db2-a44d-4bf0877fbc78', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0989ae-65e2-4862-84ab-0dd1d776341f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0989ae-65e2-4862-84ab-0dd1d776341f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819af673-5b39-44c3-91b6-0f4d10a65e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:25 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume 3ce522c6-5df5-4db2-a44d-4bf0877fbc78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce522c6-5df5-4db2-a44d-4bf0877fbc78', 'volume_size': 1}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:25 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b694a400-0645-43cf-914c-eb4cca0fca57 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Created volume successfully.
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b5cc475f-2a2f-410b-b91b-f1f2b3278977" returned: 0 in 0.715s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] <== create_volume: return (1846ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.105s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-441528866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8543a950-5b25-4a1d-90f0-ec7acb4836a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785d015c0494975b3d541d3ffd020f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:09:23Z,use_quota=True,user_id='3c92bc3dbe45494980fb4bd70daecd72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Creating volume 8543a950-5b25-4a1d-90f0-ec7acb4836a0 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:09:25 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8543a950-5b25-4a1d-90f0-ec7acb4836a0 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:25 devstack quobyte-client[82845]: System call of process 98607 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:09:25 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=134, name=volume-8543a950-5b25-4a1d-90f0-ec7acb4836a0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19dc4c2-8f80-49ad-8189-1faf08be2d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5cc475f-2a2f-410b-b91b-f1f2b3278977', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f8a7f5-0cbd-4dbf-9111-9f38d47c6ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8543a950-5b25-4a1d-90f0-ec7acb4836a0 1073741824" returned: 0 in 0.537s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8543a950-5b25-4a1d-90f0-ec7acb4836a0 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8543a950-5b25-4a1d-90f0-ec7acb4836a0" returned: 0 in 0.099s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] <== create_volume: return (686ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.862s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1181443180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce522c6-5df5-4db2-a44d-4bf0877fbc78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785d015c0494975b3d541d3ffd020f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:09:24Z,use_quota=True,user_id='3c92bc3dbe45494980fb4bd70daecd72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Creating volume 3ce522c6-5df5-4db2-a44d-4bf0877fbc78 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:09:25 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:09:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ce522c6-5df5-4db2-a44d-4bf0877fbc78 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:26 devstack quobyte-client[82845]: System call of process 98611 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:09:26 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=135, name=volume-3ce522c6-5df5-4db2-a44d-4bf0877fbc78, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:09:26 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume volume-b5cc475f-2a2f-410b-b91b-f1f2b3278977 (b5cc475f-2a2f-410b-b91b-f1f2b3278977): created successfully
Sep 10 14:09:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f8a7f5-0cbd-4dbf-9111-9f38d47c6ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Flow 'volume_create_manager' (c793193b-74e8-4363-a039-afc832e87a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:09:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ce522c6-5df5-4db2-a44d-4bf0877fbc78 1073741824" returned: 0 in 0.421s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ce522c6-5df5-4db2-a44d-4bf0877fbc78 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ce522c6-5df5-4db2-a44d-4bf0877fbc78" returned: 0 in 0.141s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:26 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] <== create_volume: return (619ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:09:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.644s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142f159e-4364-4962-a130-011d5a0bba06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8543a950-5b25-4a1d-90f0-ec7acb4836a0', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13a9523-4dac-4d8b-b9a3-8663b500af8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819af673-5b39-44c3-91b6-0f4d10a65e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce522c6-5df5-4db2-a44d-4bf0877fbc78', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f4beba-d2cd-47b7-9911-a80f1e0de28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:09:26 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume volume-8543a950-5b25-4a1d-90f0-ec7acb4836a0 (8543a950-5b25-4a1d-90f0-ec7acb4836a0): created successfully
Sep 10 14:09:26 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13a9523-4dac-4d8b-b9a3-8663b500af8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Flow 'volume_create_manager' (2272c84a-2f10-4657-a1a4-f251666363e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:09:27 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-c7bc3340-7bed-4467-925a-8656369a4112 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Created volume successfully.
Sep 10 14:09:27 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume volume-3ce522c6-5df5-4db2-a44d-4bf0877fbc78 (3ce522c6-5df5-4db2-a44d-4bf0877fbc78): created successfully
Sep 10 14:09:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f4beba-d2cd-47b7-9911-a80f1e0de28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:09:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Flow 'volume_create_manager' (eae690f5-7c53-4957-8cbd-681cec9f43a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:09:27 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-32dc8266-ed09-402f-a5bb-2eacb86b5043 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Created volume successfully.
Sep 10 14:09:27 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a1d33cc2-4c0c-4669-9304-65fd58e1c209 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Created volume successfully.
Sep 10 14:09:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "cinder-3ce522c6-5df5-4db2-a44d-4bf0877fbc78-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:09:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-3ce522c6-5df5-4db2-a44d-4bf0877fbc78-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:09:28 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:09:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "cinder-quobyte-3ce522c6-5df5-4db2-a44d-4bf0877fbc78" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:09:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-quobyte-3ce522c6-5df5-4db2-a44d-4bf0877fbc78" acquired by "delete_volume" :: waited 0.019s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:09:28 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5eb7b87-c519-4b96-8936-7fd45c595e5d]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:09:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ce522c6-5df5-4db2-a44d-4bf0877fbc78 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:29 devstack quobyte-client[82845]: System call of process 98629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:09:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ce522c6-5df5-4db2-a44d-4bf0877fbc78" returned: 0 in 0.494s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ce522c6-5df5-4db2-a44d-4bf0877fbc78 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-3ce522c6-5df5-4db2-a44d-4bf0877fbc78" returned: 0 in 0.093s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-quobyte-3ce522c6-5df5-4db2-a44d-4bf0877fbc78" released by "delete_volume" :: held 0.875s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:09:29 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Created reservations ['24452b24-7d6f-4718-9cf2-48c651d4f7d9', 'ea3242e9-2fc9-4b20-9e3f-4111447bb992', '54d31727-a140-41b5-a702-dfb6aa0da293', 'ab776e2c-ad04-45d8-a6e8-389e91266c81'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:09:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 14:09:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:09:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:09:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.271s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.186s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:09:30 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Deleted volume successfully.
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e21802d2-f982-42d6-8771-d3b27fc8fe92 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-3ce522c6-5df5-4db2-a44d-4bf0877fbc78-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "cinder-8543a950-5b25-4a1d-90f0-ec7acb4836a0-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-8543a950-5b25-4a1d-90f0-ec7acb4836a0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:09:30 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "cinder-quobyte-8543a950-5b25-4a1d-90f0-ec7acb4836a0" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-quobyte-8543a950-5b25-4a1d-90f0-ec7acb4836a0" acquired by "delete_volume" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18a6c50-a754-4649-ab48-4c60cf40a785]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:09:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8543a950-5b25-4a1d-90f0-ec7acb4836a0 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8543a950-5b25-4a1d-90f0-ec7acb4836a0" returned: 0 in 0.432s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8543a950-5b25-4a1d-90f0-ec7acb4836a0 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8543a950-5b25-4a1d-90f0-ec7acb4836a0" returned: 0 in 0.099s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-quobyte-8543a950-5b25-4a1d-90f0-ec7acb4836a0" released by "delete_volume" :: held 0.690s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:09:31 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Created reservations ['e75ecc98-e6b8-45f3-98bf-e4d7107567c2', 'c7993453-727f-4127-adbd-bab70eeaeb6b', '1fd66e94-9a9f-455e-a3af-269a4e5daab6', '5fea9a92-cd10-4d1a-b6de-3c1f4c1f287e'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:09:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:09:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:09:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.114s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:32 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:09:32 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Deleted volume successfully.
Sep 10 14:09:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-136fbddc-2204-4ffb-a4fc-f148697dbaef tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-8543a950-5b25-4a1d-90f0-ec7acb4836a0-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:09:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "cinder-b5cc475f-2a2f-410b-b91b-f1f2b3278977-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:09:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-b5cc475f-2a2f-410b-b91b-f1f2b3278977-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:09:33 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:09:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "cinder-quobyte-b5cc475f-2a2f-410b-b91b-f1f2b3278977" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:09:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-quobyte-b5cc475f-2a2f-410b-b91b-f1f2b3278977" acquired by "delete_volume" :: waited 0.017s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:09:33 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f7838b-9add-4d0f-8d61-1e6b7f77e9bc]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:09:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b5cc475f-2a2f-410b-b91b-f1f2b3278977 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b5cc475f-2a2f-410b-b91b-f1f2b3278977" returned: 0 in 0.443s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b5cc475f-2a2f-410b-b91b-f1f2b3278977 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b5cc475f-2a2f-410b-b91b-f1f2b3278977" returned: 0 in 0.099s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-quobyte-b5cc475f-2a2f-410b-b91b-f1f2b3278977" released by "delete_volume" :: held 0.699s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:09:34 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Created reservations ['f61faf27-6c64-4577-8102-3093ea1ddf0d', '69de199e-f5ef-4bfb-86a1-d312f299d3d0', '11ff8e22-6b66-4812-85d4-c5f08db0c840', 'ac15a325-1a06-4e35-855d-3c103ababd9d'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:09:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:09:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:09:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.097s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:34 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:09:34 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Deleted volume successfully.
Sep 10 14:09:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-04619d57-ba3b-4b98-90f1-6c1333b0205c tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-b5cc475f-2a2f-410b-b91b-f1f2b3278977-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:09:35 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "cinder-145be95e-4c70-4c29-848c-061cbcb2785f-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:09:35 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-145be95e-4c70-4c29-848c-061cbcb2785f-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:09:35 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:09:35 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "cinder-quobyte-145be95e-4c70-4c29-848c-061cbcb2785f" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:09:35 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-quobyte-145be95e-4c70-4c29-848c-061cbcb2785f" acquired by "delete_volume" :: waited 0.018s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:09:35 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c87c1e-fd49-4515-bc15-71750c7d1875]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:09:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-145be95e-4c70-4c29-848c-061cbcb2785f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-145be95e-4c70-4c29-848c-061cbcb2785f" returned: 0 in 0.456s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-145be95e-4c70-4c29-848c-061cbcb2785f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-145be95e-4c70-4c29-848c-061cbcb2785f" returned: 0 in 0.094s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:36 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-quobyte-145be95e-4c70-4c29-848c-061cbcb2785f" released by "delete_volume" :: held 0.734s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:09:36 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Created reservations ['20582e02-a24d-4d65-924e-d921141576a9', 'c9d95ba5-76de-4341-aa4b-1c62ce5ce620', '84180a39-071d-44ff-ac6d-886225b0c2e5', '03b1d535-a511-4492-bcc8-f89976fac35b'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:09:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:09:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:09:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.094s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:36 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:09:37 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Deleted volume successfully.
Sep 10 14:09:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-643eb781-6d9b-4c27-998c-6f9920a37ff2 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-145be95e-4c70-4c29-848c-061cbcb2785f-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:09:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "cinder-2dc56eae-8350-46d4-88c0-2c831ebefa60-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:09:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-2dc56eae-8350-46d4-88c0-2c831ebefa60-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:09:37 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:09:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "cinder-quobyte-2dc56eae-8350-46d4-88c0-2c831ebefa60" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:09:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-quobyte-2dc56eae-8350-46d4-88c0-2c831ebefa60" acquired by "delete_volume" :: waited 0.017s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:09:37 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e7a97c-e972-469f-b326-7430eb90ea5d]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:09:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dc56eae-8350-46d4-88c0-2c831ebefa60 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:38 devstack quobyte-client[82845]: System call of process 98656 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:09:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dc56eae-8350-46d4-88c0-2c831ebefa60" returned: 0 in 0.423s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dc56eae-8350-46d4-88c0-2c831ebefa60 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2dc56eae-8350-46d4-88c0-2c831ebefa60" returned: 0 in 0.099s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:38 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-quobyte-2dc56eae-8350-46d4-88c0-2c831ebefa60" released by "delete_volume" :: held 0.682s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:09:38 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Created reservations ['50f22c49-8eb3-40c7-bc75-c35e71d107e3', 'c599fcdb-eeaf-4b4d-b1e4-dd66efd2edf2', 'aeea58d2-bdd2-4b5c-b0eb-18e2460cf31f', '75e2871b-27d7-4991-af12-d294463f3b84'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:09:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:09:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:09:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.110s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:39 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:09:39 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Deleted volume successfully.
Sep 10 14:09:39 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-aba5154c-9ed6-41df-aee0-1e4b94803524 tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-2dc56eae-8350-46d4-88c0-2c831ebefa60-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:09:40 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "cinder-b9dc4f74-9018-4ef6-b2fe-50e5996ade73-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:09:40 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-b9dc4f74-9018-4ef6-b2fe-50e5996ade73-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:09:40 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:09:40 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "cinder-quobyte-b9dc4f74-9018-4ef6-b2fe-50e5996ade73" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:09:40 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-quobyte-b9dc4f74-9018-4ef6-b2fe-50e5996ade73" acquired by "delete_volume" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:09:40 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[03decfa2-71d0-4862-a4c3-105ff21ee05b]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:09:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9dc4f74-9018-4ef6-b2fe-50e5996ade73 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9dc4f74-9018-4ef6-b2fe-50e5996ade73" returned: 0 in 0.422s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9dc4f74-9018-4ef6-b2fe-50e5996ade73 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9dc4f74-9018-4ef6-b2fe-50e5996ade73" returned: 0 in 0.100s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:41 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-quobyte-b9dc4f74-9018-4ef6-b2fe-50e5996ade73" released by "delete_volume" :: held 0.659s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:09:41 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Created reservations ['4e26bf77-0223-43b2-833f-675acabfc221', '6a70db70-9c44-4475-9b47-4feeb640a816', 'ed723d15-552a-4ac6-8dd2-1172bb5f7a94', 'dd9c5ded-c293-4d44-b7d9-69e22b388413'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:09:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:09:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:09:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:09:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:09:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:09:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:09:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.099s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:09:41 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:09:41 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Deleted volume successfully.
Sep 10 14:09:41 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-68c910c9-6249-4b94-a711-4411b6e9139e tempest-CreateVolumesFromSourceVolumeTest-1412478744 None] Lock "cinder-b9dc4f74-9018-4ef6-b2fe-50e5996ade73-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:09:51 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=46,cinder:UPDATE=78,cinder:DELETE=4,cinder:INSERT=15 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:09:51 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=41,cinder:SELECT=26,cinder:DELETE=8,cinder:INSERT=9 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:10:07 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:10:21 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-c5aaca5d-540b-4117-a7f1-b3b55f346558 req-75c3a978-fb2c-4a11-a037-6c96cd68a809 tempest-TestShelveInstance-177777330 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:10:21 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-c5aaca5d-540b-4117-a7f1-b3b55f346558 req-75c3a978-fb2c-4a11-a037-6c96cd68a809 tempest-TestShelveInstance-177777330 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:10:21 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-c5aaca5d-540b-4117-a7f1-b3b55f346558 req-75c3a978-fb2c-4a11-a037-6c96cd68a809 tempest-TestShelveInstance-177777330 None] Terminate volume connection completed successfully.
Sep 10 14:10:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-c5aaca5d-540b-4117-a7f1-b3b55f346558 req-75c3a978-fb2c-4a11-a037-6c96cd68a809 tempest-TestShelveInstance-177777330 None] Deleting attachment 3b85a9c1-cbb1-4e37-9693-c93a151f1d8c. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 14:10:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-acccf3ed-590c-4850-bada-45861d1e242f req-e01dc46c-482d-499b-bd3e-f1f2848ded96 tempest-TestShelveInstance-177777330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:10:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-acccf3ed-590c-4850-bada-45861d1e242f req-e01dc46c-482d-499b-bd3e-f1f2848ded96 tempest-TestShelveInstance-177777330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:10:27 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[1601bd55-15f9-4fae-abcc-7032b97b4d40]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:10:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-acccf3ed-590c-4850-bada-45861d1e242f req-e01dc46c-482d-499b-bd3e-f1f2848ded96 tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:10:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-acccf3ed-590c-4850-bada-45861d1e242f req-e01dc46c-482d-499b-bd3e-f1f2848ded96 tempest-TestShelveInstance-177777330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187" returned: 0 in 0.375s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:10:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-acccf3ed-590c-4850-bada-45861d1e242f req-e01dc46c-482d-499b-bd3e-f1f2848ded96 tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:10:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-acccf3ed-590c-4850-bada-45861d1e242f req-e01dc46c-482d-499b-bd3e-f1f2848ded96 tempest-TestShelveInstance-177777330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187" returned: 1 in 0.357s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:10:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-acccf3ed-590c-4850-bada-45861d1e242f req-e01dc46c-482d-499b-bd3e-f1f2848ded96 tempest-TestShelveInstance-177777330 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:10:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-acccf3ed-590c-4850-bada-45861d1e242f req-e01dc46c-482d-499b-bd3e-f1f2848ded96 tempest-TestShelveInstance-177777330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.894s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:10:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-acccf3ed-590c-4850-bada-45861d1e242f req-e01dc46c-482d-499b-bd3e-f1f2848ded96 tempest-TestShelveInstance-177777330 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7', 'name': 'volume-40ab923f-83ff-43e1-97ba-1b0cbceff187', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd20859c8-9689-46ed-aee8-1b2cff0bfef3', 'enforce_multipath': True} {{(pid=82823) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 14:10:28 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-acccf3ed-590c-4850-bada-45861d1e242f req-e01dc46c-482d-499b-bd3e-f1f2848ded96 tempest-TestShelveInstance-177777330 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:10:28 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-acccf3ed-590c-4850-bada-45861d1e242f req-e01dc46c-482d-499b-bd3e-f1f2848ded96 tempest-TestShelveInstance-177777330 None] attachment_update completed successfully.
Sep 10 14:10:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 14:10:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:10:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:10:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:10:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:10:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:10:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:10:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.104s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:10:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:10:38 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:10:38 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:11:29 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 14:11:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:11:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:11:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:11:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:11:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:11:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:11:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.101s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:11:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:11:59 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-399b0c0f-3c08-43d9-ab50-861157cd99cb tempest-TestShelveInstance-177777330 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:11:59 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-399b0c0f-3c08-43d9-ab50-861157cd99cb tempest-TestShelveInstance-177777330 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:11:59 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-399b0c0f-3c08-43d9-ab50-861157cd99cb tempest-TestShelveInstance-177777330 None] Terminate volume connection completed successfully.
Sep 10 14:11:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-399b0c0f-3c08-43d9-ab50-861157cd99cb tempest-TestShelveInstance-177777330 None] Deleting attachment d20859c8-9689-46ed-aee8-1b2cff0bfef3. {{(pid=82823) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 14:11:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Acquiring lock "cinder-40ab923f-83ff-43e1-97ba-1b0cbceff187-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:11:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Lock "cinder-40ab923f-83ff-43e1-97ba-1b0cbceff187-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:11:59 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:11:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Acquiring lock "cinder-quobyte-40ab923f-83ff-43e1-97ba-1b0cbceff187" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:11:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Lock "cinder-quobyte-40ab923f-83ff-43e1-97ba-1b0cbceff187" acquired by "delete_volume" :: waited 0.014s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:12:00 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd54bb5f-7a4f-4d0e-be93-e26416242be0]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:12:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187" returned: 0 in 0.407s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187" returned: 1 in 0.393s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:12:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-40ab923f-83ff-43e1-97ba-1b0cbceff187" returned: 0 in 0.085s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:01 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Lock "cinder-quobyte-40ab923f-83ff-43e1-97ba-1b0cbceff187" released by "delete_volume" :: held 1.129s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:12:01 devstack cinder-volume[82823]: DEBUG cinder.quota [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Created reservations ['216d56ec-7a71-48ff-b407-997ca6891cad', '8d27f04a-baf1-41c7-a092-ddc05e77c452', '43c7cd96-8408-4d63-b555-26aa7d4488b4', '448b87e9-7252-487f-b674-a828b1feaaea'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:12:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.086s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:01 devstack cinder-volume[82823]: DEBUG cinder.manager [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:12:01 devstack cinder-volume[82823]: INFO cinder.volume.manager [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Deleted volume successfully.
Sep 10 14:12:02 devstack cinder-volume[82823]: DEBUG cinder.coordination [req-24d06dcc-b788-4b38-bbc2-716d327db2ab req-c93093a3-9ebe-4538-8ccb-08df40cb6dc6 tempest-TestShelveInstance-177777330 None] Lock "cinder-40ab923f-83ff-43e1-97ba-1b0cbceff187-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:12:11 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=12,cinder:SELECT=8,cinder:INSERT=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:12:11 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:12:17 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Flow 'volume_create_manager' (a58c9573-81d9-4ace-a872-869e243c5c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41aa36fe-0996-45a2-96ea-613c324305ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41aa36fe-0996-45a2-96ea-613c324305ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-671755273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040a190d-86c3-4a45-8c81-734ab76aab12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56fc61c5d7694ad088ed2d2b2a62c89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:12:17Z,use_quota=True,user_id='a3990db3c5db4ebb842f815fa5b69609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99bcb973-34a3-43f4-8068-47e6f46fc5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99bcb973-34a3-43f4-8068-47e6f46fc5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f1cc66-c895-4500-9e42-3487ff012c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f1cc66-c895-4500-9e42-3487ff012c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040a190d-86c3-4a45-8c81-734ab76aab12', 'volume_name': 'volume-040a190d-86c3-4a45-8c81-734ab76aab12', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14bb9f7d-4d5e-4f9d-a185-6523328997f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14bb9f7d-4d5e-4f9d-a185-6523328997f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654801a1-cc74-4ff7-8810-eb1c95d356c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:17 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Volume 040a190d-86c3-4a45-8c81-734ab76aab12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040a190d-86c3-4a45-8c81-734ab76aab12', 'volume_size': 1}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-671755273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040a190d-86c3-4a45-8c81-734ab76aab12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56fc61c5d7694ad088ed2d2b2a62c89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:12:17Z,use_quota=True,user_id='a3990db3c5db4ebb842f815fa5b69609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Creating volume 040a190d-86c3-4a45-8c81-734ab76aab12 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:12:17 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:12:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-040a190d-86c3-4a45-8c81-734ab76aab12 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:17 devstack quobyte-client[82845]: System call of process 99460 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:12:17 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=136, name=volume-040a190d-86c3-4a45-8c81-734ab76aab12, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-040a190d-86c3-4a45-8c81-734ab76aab12 1073741824" returned: 0 in 0.504s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-040a190d-86c3-4a45-8c81-734ab76aab12 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:18 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Flow 'volume_create_manager' (320e968d-7462-48f8-a25a-8183ae64b868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf7bc5c-3bca-4e46-bdfa-423656730aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf7bc5c-3bca-4e46-bdfa-423656730aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1108238173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ab9366-933b-46c4-beef-40008c895982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56fc61c5d7694ad088ed2d2b2a62c89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:12:18Z,use_quota=True,user_id='a3990db3c5db4ebb842f815fa5b69609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2530c37-f9c0-4cab-9541-83ce8ce2beff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2530c37-f9c0-4cab-9541-83ce8ce2beff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1c4dda-e538-4fd6-a7e2-e07aee6d6a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1c4dda-e538-4fd6-a7e2-e07aee6d6a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ab9366-933b-46c4-beef-40008c895982', 'volume_name': 'volume-36ab9366-933b-46c4-beef-40008c895982', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306d1589-ffc6-4101-b0dc-e08953e4563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306d1589-ffc6-4101-b0dc-e08953e4563f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2fa1dc-37c1-41a8-95b9-9a913dfd4bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:18 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Volume 36ab9366-933b-46c4-beef-40008c895982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ab9366-933b-46c4-beef-40008c895982', 'volume_size': 1}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:18 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Flow 'volume_create_manager' (d298a37b-6eb6-454f-bbde-dbf1308b4a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e0a308-baf3-435a-afa1-191407cc9d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-040a190d-86c3-4a45-8c81-734ab76aab12" returned: 0 in 0.652s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e0a308-baf3-435a-afa1-191407cc9d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-537492112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0359deaa-7a7c-412d-a1ae-5003c2f7380d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56fc61c5d7694ad088ed2d2b2a62c89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:12:18Z,use_quota=True,user_id='a3990db3c5db4ebb842f815fa5b69609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7128dd00-cfd7-4cf7-b747-a9e6076baf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7128dd00-cfd7-4cf7-b747-a9e6076baf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe4eb10-8e7c-4657-8a6b-2817833f0a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe4eb10-8e7c-4657-8a6b-2817833f0a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0359deaa-7a7c-412d-a1ae-5003c2f7380d', 'volume_name': 'volume-0359deaa-7a7c-412d-a1ae-5003c2f7380d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067d7e66-017b-4cd9-9705-0b549f1a7cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067d7e66-017b-4cd9-9705-0b549f1a7cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847d49a2-e9c5-4e8e-adf2-b497d3dcd5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:18 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Volume 0359deaa-7a7c-412d-a1ae-5003c2f7380d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0359deaa-7a7c-412d-a1ae-5003c2f7380d', 'volume_size': 1}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] <== create_volume: return (1241ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.122s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1108238173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ab9366-933b-46c4-beef-40008c895982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56fc61c5d7694ad088ed2d2b2a62c89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:12:18Z,use_quota=True,user_id='a3990db3c5db4ebb842f815fa5b69609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Creating volume 36ab9366-933b-46c4-beef-40008c895982 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:12:18 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:12:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-36ab9366-933b-46c4-beef-40008c895982 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:19 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:12:19 devstack quobyte-client[82845]: System call of process 99464 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:12:19 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=137, name=volume-36ab9366-933b-46c4-beef-40008c895982, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Flow 'volume_create_manager' (9afd0e07-8834-4df5-a207-9fd473713118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b27a73-38ca-41c0-a99a-75bdc6307825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654801a1-cc74-4ff7-8810-eb1c95d356c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040a190d-86c3-4a45-8c81-734ab76aab12', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7b76d2-2e15-4a5d-a911-dceb82621a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b27a73-38ca-41c0-a99a-75bdc6307825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-585702652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ab1645-715f-4000-aca8-689480287c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56fc61c5d7694ad088ed2d2b2a62c89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:12:19Z,use_quota=True,user_id='a3990db3c5db4ebb842f815fa5b69609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0e8036-d081-476c-8a10-617ae86a369f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0e8036-d081-476c-8a10-617ae86a369f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5960aa8a-ed13-416e-af4a-c5ea7910f2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5960aa8a-ed13-416e-af4a-c5ea7910f2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ab1645-715f-4000-aca8-689480287c9d', 'volume_name': 'volume-b9ab1645-715f-4000-aca8-689480287c9d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e71d2a1-0b99-4b79-b33c-1fb11e887447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e71d2a1-0b99-4b79-b33c-1fb11e887447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f8650a-6051-43d4-84a4-3fdb711faa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:19 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Volume b9ab1645-715f-4000-aca8-689480287c9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ab1645-715f-4000-aca8-689480287c9d', 'volume_size': 1}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:19 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Flow 'volume_create_manager' (8ed11485-720c-41b9-98f6-63c400bc488f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8f5ac9-f6ef-456c-937d-c3791f78d11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8f5ac9-f6ef-456c-937d-c3791f78d11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-799546861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21d9a68-11f4-4af2-a2e3-870d76c21549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56fc61c5d7694ad088ed2d2b2a62c89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:12:19Z,use_quota=True,user_id='a3990db3c5db4ebb842f815fa5b69609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37089ef-a6a0-427c-aa03-4314baa96ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37089ef-a6a0-427c-aa03-4314baa96ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b97dea-2fa1-4296-906d-c4c34b01e7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b97dea-2fa1-4296-906d-c4c34b01e7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21d9a68-11f4-4af2-a2e3-870d76c21549', 'volume_name': 'volume-f21d9a68-11f4-4af2-a2e3-870d76c21549', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4885f882-d1b8-4414-92d7-3f5a22fe1802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4885f882-d1b8-4414-92d7-3f5a22fe1802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0da99da-6898-4cb4-af80-a834dc6efd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:19 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Volume f21d9a68-11f4-4af2-a2e3-870d76c21549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21d9a68-11f4-4af2-a2e3-870d76c21549', 'volume_size': 1}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:19 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Volume volume-040a190d-86c3-4a45-8c81-734ab76aab12 (040a190d-86c3-4a45-8c81-734ab76aab12): created successfully
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7b76d2-2e15-4a5d-a911-dceb82621a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Flow 'volume_create_manager' (a58c9573-81d9-4ace-a872-869e243c5c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-36ab9366-933b-46c4-beef-40008c895982 1073741824" returned: 0 in 0.757s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-36ab9366-933b-46c4-beef-40008c895982 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:19 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-ae86cc22-bd42-40a4-9ed8-9d07eac0d40c tempest-CreateVolumesFromImageTest-569205447 None] Created volume successfully.
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-36ab9366-933b-46c4-beef-40008c895982" returned: 0 in 0.254s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] <== create_volume: return (1031ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.102s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-537492112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0359deaa-7a7c-412d-a1ae-5003c2f7380d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56fc61c5d7694ad088ed2d2b2a62c89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:12:18Z,use_quota=True,user_id='a3990db3c5db4ebb842f815fa5b69609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Creating volume 0359deaa-7a7c-412d-a1ae-5003c2f7380d {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:12:20 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0359deaa-7a7c-412d-a1ae-5003c2f7380d 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:20 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=138, name=volume-0359deaa-7a7c-412d-a1ae-5003c2f7380d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2fa1dc-37c1-41a8-95b9-9a913dfd4bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ab9366-933b-46c4-beef-40008c895982', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f838501-8c52-4b10-9f43-a6daacdded7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0359deaa-7a7c-412d-a1ae-5003c2f7380d 1073741824" returned: 0 in 0.496s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0359deaa-7a7c-412d-a1ae-5003c2f7380d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:20 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Volume volume-36ab9366-933b-46c4-beef-40008c895982 (36ab9366-933b-46c4-beef-40008c895982): created successfully
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f838501-8c52-4b10-9f43-a6daacdded7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Flow 'volume_create_manager' (320e968d-7462-48f8-a25a-8183ae64b868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:12:20 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f3452dfe-8b92-417b-832e-86f488249fbd tempest-CreateVolumesFromImageTest-569205447 None] Created volume successfully.
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0359deaa-7a7c-412d-a1ae-5003c2f7380d" returned: 0 in 0.348s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] <== create_volume: return (867ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.303s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-585702652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ab1645-715f-4000-aca8-689480287c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56fc61c5d7694ad088ed2d2b2a62c89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:12:19Z,use_quota=True,user_id='a3990db3c5db4ebb842f815fa5b69609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Creating volume b9ab1645-715f-4000-aca8-689480287c9d {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:12:20 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:12:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9ab1645-715f-4000-aca8-689480287c9d 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:21 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=139, name=volume-b9ab1645-715f-4000-aca8-689480287c9d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847d49a2-e9c5-4e8e-adf2-b497d3dcd5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0359deaa-7a7c-412d-a1ae-5003c2f7380d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcc986b-c0cf-4ec4-93cf-d3afddaeac01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9ab1645-715f-4000-aca8-689480287c9d 1073741824" returned: 0 in 0.380s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9ab1645-715f-4000-aca8-689480287c9d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:21 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Volume volume-0359deaa-7a7c-412d-a1ae-5003c2f7380d (0359deaa-7a7c-412d-a1ae-5003c2f7380d): created successfully
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcc986b-c0cf-4ec4-93cf-d3afddaeac01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Flow 'volume_create_manager' (d298a37b-6eb6-454f-bbde-dbf1308b4a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9ab1645-715f-4000-aca8-689480287c9d" returned: 0 in 0.346s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] <== create_volume: return (747ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.984s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-799546861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21d9a68-11f4-4af2-a2e3-870d76c21549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56fc61c5d7694ad088ed2d2b2a62c89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:12:19Z,use_quota=True,user_id='a3990db3c5db4ebb842f815fa5b69609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Creating volume f21d9a68-11f4-4af2-a2e3-870d76c21549 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:12:21 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:12:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f21d9a68-11f4-4af2-a2e3-870d76c21549 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:21 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-5e412d7a-531d-4164-8cf6-f681fc2a39d6 tempest-CreateVolumesFromImageTest-569205447 None] Created volume successfully.
Sep 10 14:12:21 devstack quobyte-client[82845]: System call of process 99478 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:12:21 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=140, name=volume-f21d9a68-11f4-4af2-a2e3-870d76c21549, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:12:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f8650a-6051-43d4-84a4-3fdb711faa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ab1645-715f-4000-aca8-689480287c9d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89edac64-39e4-4e2e-8082-6b6cf8bd2660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f21d9a68-11f4-4af2-a2e3-870d76c21549 1073741824" returned: 0 in 0.428s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f21d9a68-11f4-4af2-a2e3-870d76c21549 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f21d9a68-11f4-4af2-a2e3-870d76c21549" returned: 0 in 0.130s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:22 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] <== create_volume: return (598ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:12:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.617s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:22 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Volume volume-b9ab1645-715f-4000-aca8-689480287c9d (b9ab1645-715f-4000-aca8-689480287c9d): created successfully
Sep 10 14:12:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89edac64-39e4-4e2e-8082-6b6cf8bd2660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Flow 'volume_create_manager' (9afd0e07-8834-4df5-a207-9fd473713118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:12:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0da99da-6898-4cb4-af80-a834dc6efd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21d9a68-11f4-4af2-a2e3-870d76c21549', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da00fa56-0814-4249-a5fd-7625aa49d4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:22 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-7fa0af7f-1399-490d-a31e-c2528cc28b5a tempest-CreateVolumesFromImageTest-569205447 None] Created volume successfully.
Sep 10 14:12:22 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Volume volume-f21d9a68-11f4-4af2-a2e3-870d76c21549 (f21d9a68-11f4-4af2-a2e3-870d76c21549): created successfully
Sep 10 14:12:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da00fa56-0814-4249-a5fd-7625aa49d4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Flow 'volume_create_manager' (8ed11485-720c-41b9-98f6-63c400bc488f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:12:22 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-947a160b-4789-4e23-99bd-598a9fc13148 tempest-CreateVolumesFromImageTest-569205447 None] Created volume successfully.
Sep 10 14:12:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "cinder-f21d9a68-11f4-4af2-a2e3-870d76c21549-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:12:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-f21d9a68-11f4-4af2-a2e3-870d76c21549-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:12:23 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:12:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "cinder-quobyte-f21d9a68-11f4-4af2-a2e3-870d76c21549" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:12:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-quobyte-f21d9a68-11f4-4af2-a2e3-870d76c21549" acquired by "delete_volume" :: waited 0.014s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:12:23 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4e2d73-b3d5-4120-a5d3-155a9010a600]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:12:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f21d9a68-11f4-4af2-a2e3-870d76c21549 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f21d9a68-11f4-4af2-a2e3-870d76c21549" returned: 0 in 0.406s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f21d9a68-11f4-4af2-a2e3-870d76c21549 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-f21d9a68-11f4-4af2-a2e3-870d76c21549" returned: 0 in 0.113s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-quobyte-f21d9a68-11f4-4af2-a2e3-870d76c21549" released by "delete_volume" :: held 0.687s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:12:23 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Created reservations ['f58f1421-415e-481a-9b04-b9aee114433f', '07143874-f897-426d-a117-67e542a5625f', 'f52dd698-16f1-4df7-9746-b0ffdb1dce47', 'fffc269c-cb96-4420-b4ae-0a50207bb1aa'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:12:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.088s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:24 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:12:24 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Deleted volume successfully.
Sep 10 14:12:24 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4746c0ed-be0c-41e9-8395-7305f64c448a tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-f21d9a68-11f4-4af2-a2e3-870d76c21549-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:12:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "cinder-b9ab1645-715f-4000-aca8-689480287c9d-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:12:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-b9ab1645-715f-4000-aca8-689480287c9d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:12:25 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:12:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "cinder-quobyte-b9ab1645-715f-4000-aca8-689480287c9d" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:12:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-quobyte-b9ab1645-715f-4000-aca8-689480287c9d" acquired by "delete_volume" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:12:25 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61f6c80-372b-4061-bbef-934f5ada0276]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:12:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9ab1645-715f-4000-aca8-689480287c9d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9ab1645-715f-4000-aca8-689480287c9d" returned: 0 in 0.392s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9ab1645-715f-4000-aca8-689480287c9d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b9ab1645-715f-4000-aca8-689480287c9d" returned: 0 in 0.110s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:25 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-quobyte-b9ab1645-715f-4000-aca8-689480287c9d" released by "delete_volume" :: held 0.645s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:12:26 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Created reservations ['b85a2fbc-5f4c-4fc4-a4ca-c65c54d01f5b', 'd0de6a78-cbe9-4e27-892a-92942c11a59c', '73cb1710-d970-4b5e-adc0-34454974b4e7', 'd8e80162-5626-418f-9eb0-79b1e4d6fa26'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:12:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:26 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:26 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.127s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:26 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:12:26 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Deleted volume successfully.
Sep 10 14:12:26 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-225e1414-784c-4843-a935-089a5f45c716 tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-b9ab1645-715f-4000-aca8-689480287c9d-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:12:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "cinder-0359deaa-7a7c-412d-a1ae-5003c2f7380d-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:12:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-0359deaa-7a7c-412d-a1ae-5003c2f7380d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:12:27 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:12:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "cinder-quobyte-0359deaa-7a7c-412d-a1ae-5003c2f7380d" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:12:27 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-quobyte-0359deaa-7a7c-412d-a1ae-5003c2f7380d" acquired by "delete_volume" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:12:27 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb5a1e9-9b7b-498e-9d67-c793fdd0b9d4]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:12:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0359deaa-7a7c-412d-a1ae-5003c2f7380d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0359deaa-7a7c-412d-a1ae-5003c2f7380d" returned: 0 in 0.414s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0359deaa-7a7c-412d-a1ae-5003c2f7380d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-0359deaa-7a7c-412d-a1ae-5003c2f7380d" returned: 0 in 0.097s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-quobyte-0359deaa-7a7c-412d-a1ae-5003c2f7380d" released by "delete_volume" :: held 0.667s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:12:28 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Created reservations ['4423e80a-1da5-4382-943e-8bd832569d2d', '50c6e353-1e14-4218-a111-04f1723a3359', 'b62dac15-454d-44e2-8a4e-266644111c52', '11f25425-984d-4d1f-aaff-1fd00593dd21'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:12:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:28 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.092s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:28 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:12:28 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Deleted volume successfully.
Sep 10 14:12:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-c08af021-530b-4c3e-b6f1-aed3576892ea tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-0359deaa-7a7c-412d-a1ae-5003c2f7380d-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:12:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "cinder-36ab9366-933b-46c4-beef-40008c895982-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:12:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-36ab9366-933b-46c4-beef-40008c895982-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:12:29 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:12:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "cinder-quobyte-36ab9366-933b-46c4-beef-40008c895982" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:12:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-quobyte-36ab9366-933b-46c4-beef-40008c895982" acquired by "delete_volume" :: waited 0.010s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:12:29 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f587f7-cac0-4625-b485-38cd36ef088d]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:12:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-36ab9366-933b-46c4-beef-40008c895982 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:30 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 14:12:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.168s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:12:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-36ab9366-933b-46c4-beef-40008c895982" returned: 0 in 0.512s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-36ab9366-933b-46c4-beef-40008c895982 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-36ab9366-933b-46c4-beef-40008c895982" returned: 0 in 0.085s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-quobyte-36ab9366-933b-46c4-beef-40008c895982" released by "delete_volume" :: held 0.759s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:12:30 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Created reservations ['086aba2e-5237-4099-85d3-9136118e431a', '9dec78ee-3d3d-469c-a834-ce689690e646', 'c949ef73-9307-42d9-98d8-9dcd5fd07409', 'cee8ddd3-7108-4ede-9602-38ca4678ae74'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:12:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.082s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:31 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:12:31 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Deleted volume successfully.
Sep 10 14:12:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-589d080b-c43a-4d91-8c3a-5ce5ef61e7ff tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-36ab9366-933b-46c4-beef-40008c895982-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:12:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "cinder-040a190d-86c3-4a45-8c81-734ab76aab12-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:12:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-040a190d-86c3-4a45-8c81-734ab76aab12-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:12:32 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:12:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "cinder-quobyte-040a190d-86c3-4a45-8c81-734ab76aab12" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:12:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-quobyte-040a190d-86c3-4a45-8c81-734ab76aab12" acquired by "delete_volume" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:12:32 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[19797905-742d-4f8b-acad-fa6f865ad93f]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:12:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-040a190d-86c3-4a45-8c81-734ab76aab12 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-040a190d-86c3-4a45-8c81-734ab76aab12" returned: 0 in 0.372s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-040a190d-86c3-4a45-8c81-734ab76aab12 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-040a190d-86c3-4a45-8c81-734ab76aab12" returned: 0 in 0.086s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-quobyte-040a190d-86c3-4a45-8c81-734ab76aab12" released by "delete_volume" :: held 0.638s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:12:33 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Created reservations ['e1a342a8-f320-4bbc-886b-cde044e53774', 'df59a624-0969-4fa2-9974-2a3edd660729', '4062afc6-9b0f-400a-9160-ef16a296ec91', 'f02c32fe-036d-4bf5-b7e9-e9f1d76fbe4b'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:12:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.116s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:33 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:12:33 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Deleted volume successfully.
Sep 10 14:12:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-337115a3-018a-47a2-beec-6890c36f6066 tempest-CreateVolumesFromImageTest-569205447 None] Lock "cinder-040a190d-86c3-4a45-8c81-734ab76aab12-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:12:38 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:12:38 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:12:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Flow 'volume_create_manager' (643f4c8d-aefb-42c7-9332-6e0188b85ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:12:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a7b251-0a4d-496a-84f0-2ae43bfbdd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a7b251-0a4d-496a-84f0-2ae43bfbdd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13953e58-500b-43ea-90d4-f20e0e0f4f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e79d891d0f4f83a2bb339e649ec383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:12:39Z,use_quota=True,user_id='9b2ee171e2404631a74bd03512c9966b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8f2c9c-7e7d-4ec3-8ae1-9b617d4d2d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8f2c9c-7e7d-4ec3-8ae1-9b617d4d2d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba5e753-fc18-43e4-bfc2-94aa50743636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba5e753-fc18-43e4-bfc2-94aa50743636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '13953e58-500b-43ea-90d4-f20e0e0f4f95', 'volume_name': 'volume-13953e58-500b-43ea-90d4-f20e0e0f4f95', 'volume_size': 1, 'image_id': '8281b672-2ce3-4d1c-a500-38dccdaba209', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '017165c3d7fda9f730c775fb34507493', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69e79d891d0f4f83a2bb339e649ec383', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bd0cc1551769229d4c69b41989257028fb9803894c9b19432cb1045a3c110445b237eb4f9cf68931d8fda672a45744dfaf23bc76165f0272271f74e187505c20', 'id': '8281b672-2ce3-4d1c-a500-38dccdaba209', 'created_at': datetime.datetime(2025, 9, 10, 12, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 12, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8281b672-2ce3-4d1c-a500-38dccdaba209/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b56f3b80>}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fd0cc3-742f-4ff8-b06c-5b71cd9325fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fd0cc3-742f-4ff8-b06c-5b71cd9325fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affbffbb-fa6c-4d49-a7d7-cb96d66ef270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:39 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Volume 13953e58-500b-43ea-90d4-f20e0e0f4f95: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-13953e58-500b-43ea-90d4-f20e0e0f4f95', 'volume_size': 1, 'image_id': '8281b672-2ce3-4d1c-a500-38dccdaba209', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '017165c3d7fda9f730c775fb34507493', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69e79d891d0f4f83a2bb339e649ec383', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bd0cc1551769229d4c69b41989257028fb9803894c9b19432cb1045a3c110445b237eb4f9cf68931d8fda672a45744dfaf23bc76165f0272271f74e187505c20', 'id': '8281b672-2ce3-4d1c-a500-38dccdaba209', 'created_at': datetime.datetime(2025, 9, 10, 12, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 12, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8281b672-2ce3-4d1c-a500-38dccdaba209/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b56f3b80>}
Sep 10 14:12:39 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Cloning 13953e58-500b-43ea-90d4-f20e0e0f4f95 from image 8281b672-2ce3-4d1c-a500-38dccdaba209  at location (None, None). {{(pid=82823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 14:12:39 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 14:12:39 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Image download 0.00 MB at 0.00 MB/s
Sep 10 14:12:39 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be37cb8-26aa-449e-abc2-678428059f59]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:12:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:39 devstack sudo[99548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD
Sep 10 14:12:39 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 14:12:41 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root
Sep 10 14:12:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD" returned: 0 in 1.998s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:41 devstack sudo[99552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD
Sep 10 14:12:41 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 14:12:43 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root
Sep 10 14:12:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD" returned: 1 in 1.844s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:12:43 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Temporary image 8281b672-2ce3-4d1c-a500-38dccdaba209 is fetched for user 9b2ee171e2404631a74bd03512c9966b. {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 14:12:43 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[880f0122-8794-4125-b5af-8db3d709581b]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:12:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:43 devstack sudo[99557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD
Sep 10 14:12:43 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 14:12:45 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root
Sep 10 14:12:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD" returned: 0 in 1.860s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:45 devstack sudo[99563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD
Sep 10 14:12:45 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 14:12:47 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD" returned: 1 in 1.910s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13953e58-500b-43ea-90d4-f20e0e0f4f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e79d891d0f4f83a2bb339e649ec383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:12:39Z,use_quota=True,user_id='9b2ee171e2404631a74bd03512c9966b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Creating volume 13953e58-500b-43ea-90d4-f20e0e0f4f95 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:12:47 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:47 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=141, name=volume-13953e58-500b-43ea-90d4-f20e0e0f4f95, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95 1073741824" returned: 0 in 0.288s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95" returned: 0 in 0.081s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] <== create_volume: return (451ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:12:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.482s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:48 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Attempting download of 8281b672-2ce3-4d1c-a500-38dccdaba209 ((None, None)) to volume 13953e58-500b-43ea-90d4-f20e0e0f4f95. {{(pid=82823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 14:12:48 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[200e387b-a773-4fe4-83b1-19ef978e548b]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:12:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8281b672-2ce3-4d1c-a500-38dccdaba209_t1fi16jr {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8281b672-2ce3-4d1c-a500-38dccdaba209_t1fi16jr" returned: 0 in 0.344s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8281b672-2ce3-4d1c-a500-38dccdaba209_t1fi16jr {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8281b672-2ce3-4d1c-a500-38dccdaba209_t1fi16jr" returned: 1 in 0.342s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8281b672-2ce3-4d1c-a500-38dccdaba209_t1fi16jr' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:12:49 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05ab9c7-a52d-49ca-b79d-1057280b1fca]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:12:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:12:49 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] 8281b672-2ce3-4d1c-a500-38dccdaba209 was raw, converting to raw {{(pid=82823) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 14:12:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:49 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=141, name=volume-13953e58-500b-43ea-90d4-f20e0e0f4f95, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:12:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95" returned: 0 in 0.146s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:49 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8281b672-2ce3-4d1c-a500-38dccdaba209_167yx8bodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95 {{(pid=82823) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 14:12:49 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Converted 0.00 MB image at 0.00 MB/s
Sep 10 14:12:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95 1G" returned: 0 in 0.135s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:50 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[3117ce62-5178-4c77-97d5-4cf91752e2ac]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:12:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95" returned: 0 in 0.410s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95" returned: 1 in 0.347s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:12:51 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Downloaded image 8281b672-2ce3-4d1c-a500-38dccdaba209 ((None, None)) to volume 13953e58-500b-43ea-90d4-f20e0e0f4f95 successfully. {{(pid=82823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 14:12:51 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Temporary image 8281b672-2ce3-4d1c-a500-38dccdaba209 for user 9b2ee171e2404631a74bd03512c9966b is deleted. {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 14:12:51 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Marking volume 13953e58-500b-43ea-90d4-f20e0e0f4f95 as bootable. {{(pid=82823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 14:12:51 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Copying metadata from image 8281b672-2ce3-4d1c-a500-38dccdaba209 to 13953e58-500b-43ea-90d4-f20e0e0f4f95. {{(pid=82823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 14:12:51 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Creating volume glance metadata for volume 13953e58-500b-43ea-90d4-f20e0e0f4f95 backed by image 8281b672-2ce3-4d1c-a500-38dccdaba209 with: {'image_id': '8281b672-2ce3-4d1c-a500-38dccdaba209', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '017165c3d7fda9f730c775fb34507493', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 14:12:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affbffbb-fa6c-4d49-a7d7-cb96d66ef270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13953e58-500b-43ea-90d4-f20e0e0f4f95', 'volume_size': 1, 'image_id': '8281b672-2ce3-4d1c-a500-38dccdaba209', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '017165c3d7fda9f730c775fb34507493', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69e79d891d0f4f83a2bb339e649ec383', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bd0cc1551769229d4c69b41989257028fb9803894c9b19432cb1045a3c110445b237eb4f9cf68931d8fda672a45744dfaf23bc76165f0272271f74e187505c20', 'id': '8281b672-2ce3-4d1c-a500-38dccdaba209', 'created_at': datetime.datetime(2025, 9, 10, 12, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 12, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8281b672-2ce3-4d1c-a500-38dccdaba209/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b56f3b80>}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c5361e-c3ba-4b2f-90ff-82bac59cb4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:51 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Volume volume-13953e58-500b-43ea-90d4-f20e0e0f4f95 (13953e58-500b-43ea-90d4-f20e0e0f4f95): created successfully
Sep 10 14:12:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c5361e-c3ba-4b2f-90ff-82bac59cb4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:51 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Flow 'volume_create_manager' (643f4c8d-aefb-42c7-9332-6e0188b85ff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:12:51 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-8c275bde-26f9-4eb4-8926-85b325dc8ab9 tempest-VolumeImageDependencyTests-741770239 None] Created volume successfully.
Sep 10 14:12:51 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Acquiring lock "cinder-13953e58-500b-43ea-90d4-f20e0e0f4f95-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:12:51 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Lock "cinder-13953e58-500b-43ea-90d4-f20e0e0f4f95-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:12:52 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:12:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Acquiring lock "cinder-quobyte-13953e58-500b-43ea-90d4-f20e0e0f4f95" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:12:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Lock "cinder-quobyte-13953e58-500b-43ea-90d4-f20e0e0f4f95" acquired by "delete_volume" :: waited 0.011s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:12:52 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a9cfab-87c4-44e3-a060-02169ccafcf3]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:12:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95" returned: 0 in 0.354s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95" returned: 1 in 0.345s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:12:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-13953e58-500b-43ea-90d4-f20e0e0f4f95" returned: 0 in 0.076s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Lock "cinder-quobyte-13953e58-500b-43ea-90d4-f20e0e0f4f95" released by "delete_volume" :: held 0.992s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:12:53 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Created reservations ['9892e695-02f4-4397-8d8c-b824bee475dc', 'd11424db-6baa-4aba-a570-42727a2ed96d', '56f6e127-e0c9-4839-a5f8-95420aa62936', '81311882-66fe-4c14-9740-bc7d2b3f3175'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:12:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:53 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.085s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:53 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:12:53 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Deleted volume successfully.
Sep 10 14:12:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d0f4cb43-59c9-4552-b125-ed5d12de90db tempest-VolumeImageDependencyTests-741770239 None] Lock "cinder-13953e58-500b-43ea-90d4-f20e0e0f4f95-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:12:57 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Flow 'volume_create_manager' (73a03d76-c258-4816-b166-c8ed9b8f5bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fda9fa9-4709-4f67-a5f9-c61a585c2127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fda9fa9-4709-4f67-a5f9-c61a585c2127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82bec93-fc81-4ee8-be3f-00df500e19ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73950ea2e8d8437fa5d3c85970d98312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:12:57Z,use_quota=True,user_id='56ed8dc56bd040c58f632dcae9e28997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb8ff0b-9136-44b9-a1a7-54ce8ab08e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb8ff0b-9136-44b9-a1a7-54ce8ab08e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6bd1f0-869a-4d15-a306-f8163db1835f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6bd1f0-869a-4d15-a306-f8163db1835f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd82bec93-fc81-4ee8-be3f-00df500e19ac', 'volume_name': 'volume-d82bec93-fc81-4ee8-be3f-00df500e19ac', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41146fe4-08ce-4193-add1-fb5ff3a05ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41146fe4-08ce-4193-add1-fb5ff3a05ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1c9291-bc10-4b47-a244-7fab340b82d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:57 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Volume d82bec93-fc81-4ee8-be3f-00df500e19ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d82bec93-fc81-4ee8-be3f-00df500e19ac', 'volume_size': 1}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82bec93-fc81-4ee8-be3f-00df500e19ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73950ea2e8d8437fa5d3c85970d98312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:12:57Z,use_quota=True,user_id='56ed8dc56bd040c58f632dcae9e28997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Creating volume d82bec93-fc81-4ee8-be3f-00df500e19ac {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:12:57 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d82bec93-fc81-4ee8-be3f-00df500e19ac 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:57 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=142, name=volume-d82bec93-fc81-4ee8-be3f-00df500e19ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d82bec93-fc81-4ee8-be3f-00df500e19ac 1073741824" returned: 0 in 0.412s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d82bec93-fc81-4ee8-be3f-00df500e19ac {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d82bec93-fc81-4ee8-be3f-00df500e19ac" returned: 0 in 0.123s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] <== create_volume: return (607ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:12:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.619s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1c9291-bc10-4b47-a244-7fab340b82d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d82bec93-fc81-4ee8-be3f-00df500e19ac', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a623ad-0981-4b41-ac8f-420a57180fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:58 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Volume volume-d82bec93-fc81-4ee8-be3f-00df500e19ac (d82bec93-fc81-4ee8-be3f-00df500e19ac): created successfully
Sep 10 14:12:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a623ad-0981-4b41-ac8f-420a57180fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:58 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Flow 'volume_create_manager' (73a03d76-c258-4816-b166-c8ed9b8f5bf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:12:58 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a018f242-9a2e-4ff4-8a34-3cc9c7faf83f tempest-CinderUnicodeTest-1773309803 None] Created volume successfully.
Sep 10 14:12:59 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Flow 'volume_create_manager' (12e5d0b2-8635-4a84-9239-14e5f87d7980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7f5800-43eb-4718-ba58-df1fd2dd4ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7f5800-43eb-4718-ba58-df1fd2dd4ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-419345883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1157829-7676-44fe-adee-19dbd0a24dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73950ea2e8d8437fa5d3c85970d98312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:00Z,use_quota=True,user_id='56ed8dc56bd040c58f632dcae9e28997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28317c77-4e25-4b83-97fa-06beca20764f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28317c77-4e25-4b83-97fa-06beca20764f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd72915-ffc0-429e-b6b7-579095794afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd72915-ffc0-429e-b6b7-579095794afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1157829-7676-44fe-adee-19dbd0a24dc2', 'volume_name': 'volume-e1157829-7676-44fe-adee-19dbd0a24dc2', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac6197f-404e-49f3-956f-554f94209080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac6197f-404e-49f3-956f-554f94209080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1d0b24-c5f4-480b-8759-7454c7545eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:12:59 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Volume e1157829-7676-44fe-adee-19dbd0a24dc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1157829-7676-44fe-adee-19dbd0a24dc2', 'volume_size': 1}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:12:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-419345883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1157829-7676-44fe-adee-19dbd0a24dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73950ea2e8d8437fa5d3c85970d98312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:00Z,use_quota=True,user_id='56ed8dc56bd040c58f632dcae9e28997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Creating volume e1157829-7676-44fe-adee-19dbd0a24dc2 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:12:59 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:12:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:00 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=143, name=volume-e1157829-7676-44fe-adee-19dbd0a24dc2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:13:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2 1073741824" returned: 0 in 0.324s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2" returned: 0 in 0.081s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] <== create_volume: return (465ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:13:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.476s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1d0b24-c5f4-480b-8759-7454c7545eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1157829-7676-44fe-adee-19dbd0a24dc2', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cabc363d-1f4e-4802-bd49-769ba2de57df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:00 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Volume volume-e1157829-7676-44fe-adee-19dbd0a24dc2 (e1157829-7676-44fe-adee-19dbd0a24dc2): created successfully
Sep 10 14:13:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cabc363d-1f4e-4802-bd49-769ba2de57df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Flow 'volume_create_manager' (12e5d0b2-8635-4a84-9239-14e5f87d7980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:00 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-19eeddcf-85bb-4fd2-9f65-56d2d2b63811 tempest-CinderUnicodeTest-1773309803 None] Created volume successfully.
Sep 10 14:13:01 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] Creating offline snapshot 034bae7d-f5b6-4f15-9329-b66338a9e784 of volume e1157829-7676-44fe-adee-19dbd0a24dc2 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:13:01 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0cc0a3-f0fd-4716-b0f7-7699a019d5ec]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:13:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2" returned: 0 in 0.404s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:01 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=144, name=volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:13:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784 1G" returned: 0 in 0.223s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e1157829-7676-44fe-adee-19dbd0a24dc2 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] CMD "qemu-img rebase -u -b volume-e1157829-7676-44fe-adee-19dbd0a24dc2 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784" returned: 0 in 0.133s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:13:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784" returned: 0 in 0.085s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:13:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784" returned: 0 in 0.102s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.info" returned: 0 in 0.087s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:13:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.info" returned: 0 in 0.077s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.440s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:02 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-727c68c3-a271-47f2-8e33-80e09f62699d tempest-CinderUnicodeTest-1773309803 None] Create snapshot completed successfully
Sep 10 14:13:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Acquiring lock "cinder-034bae7d-f5b6-4f15-9329-b66338a9e784-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Lock "cinder-034bae7d-f5b6-4f15-9329-b66338a9e784-delete_snapshot" acquired by "delete_snapshot" :: waited 0.088s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:03 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Acquiring lock "cinder-quobyte-e1157829-7676-44fe-adee-19dbd0a24dc2" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Lock "cinder-quobyte-e1157829-7676-44fe-adee-19dbd0a24dc2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Acquiring lock "cinder-quobyte-034bae7d-f5b6-4f15-9329-b66338a9e784" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Lock "cinder-quobyte-034bae7d-f5b6-4f15-9329-b66338a9e784" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Deleting offline snapshot 034bae7d-f5b6-4f15-9329-b66338a9e784 of volume e1157829-7676-44fe-adee-19dbd0a24dc2 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:13:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] snapshot_file for this snap is: volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:13:03 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4a9616-23c5-4120-994a-cb053835a7e1]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:13:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784" returned: 0 in 0.366s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1157829-7676-44fe-adee-19dbd0a24dc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:13:03 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9941e14-b84c-4d12-a6db-a6ca5128a3db]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:13:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2" returned: 0 in 0.381s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784" returned: 0 in 0.222s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2.034bae7d-f5b6-4f15-9329-b66338a9e784" returned: 0 in 0.083s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Lock "cinder-quobyte-034bae7d-f5b6-4f15-9329-b66338a9e784" released by "_delete_snapshot" :: held 1.329s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:04 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Lock "cinder-quobyte-e1157829-7676-44fe-adee-19dbd0a24dc2" released by "delete_snapshot" :: held 1.357s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:05 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Created reservations ['ece08beb-4c88-4778-86f8-551fed06e9b0', 'eadbb3c4-90a1-46b6-a50d-fc13fedf533c', '849f63de-6b22-48e4-ac88-729760223bb4', '8f5cca4a-52fe-4727-bcd3-c14e7136a088'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:13:05 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Delete snapshot completed successfully.
Sep 10 14:13:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f071a571-5c95-4f57-9805-5f6f4118f12f tempest-CinderUnicodeTest-1773309803 None] Lock "cinder-034bae7d-f5b6-4f15-9329-b66338a9e784-delete_snapshot" released by "delete_snapshot" :: held 1.821s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Acquiring lock "cinder-e1157829-7676-44fe-adee-19dbd0a24dc2-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Lock "cinder-e1157829-7676-44fe-adee-19dbd0a24dc2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:05 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Acquiring lock "cinder-quobyte-e1157829-7676-44fe-adee-19dbd0a24dc2" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:05 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Lock "cinder-quobyte-e1157829-7676-44fe-adee-19dbd0a24dc2" acquired by "delete_volume" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:05 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[75981833-66a7-4aa7-ac01-7c926843dc0c]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:13:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2" returned: 0 in 0.386s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-e1157829-7676-44fe-adee-19dbd0a24dc2" returned: 0 in 0.111s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Lock "cinder-quobyte-e1157829-7676-44fe-adee-19dbd0a24dc2" released by "delete_volume" :: held 0.643s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:06 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Created reservations ['c402c671-a761-429b-9f76-4ab8417ab3ea', 'f08063a6-cb1f-4232-b855-cb078d58c1c4', 'c5e7e073-eb3f-4cdb-950e-2d9c6f840500', '8e1809ac-14db-464d-b9dd-d9a5a7c34022'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:13:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Acquiring lock "cinder-d82bec93-fc81-4ee8-be3f-00df500e19ac-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Lock "cinder-d82bec93-fc81-4ee8-be3f-00df500e19ac-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.389s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:07 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:13:07 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Deleted volume successfully.
Sep 10 14:13:07 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Acquiring lock "cinder-quobyte-d82bec93-fc81-4ee8-be3f-00df500e19ac" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8a867992-f9a7-468d-beb7-a4c3fc57ba06 tempest-CinderUnicodeTest-1773309803 None] Lock "cinder-e1157829-7676-44fe-adee-19dbd0a24dc2-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Lock "cinder-quobyte-d82bec93-fc81-4ee8-be3f-00df500e19ac" acquired by "delete_volume" :: waited 0.027s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:07 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f58f51-197e-4e3e-a9a9-3345a6efa68a]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:13:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d82bec93-fc81-4ee8-be3f-00df500e19ac {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d82bec93-fc81-4ee8-be3f-00df500e19ac" returned: 0 in 0.388s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d82bec93-fc81-4ee8-be3f-00df500e19ac {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d82bec93-fc81-4ee8-be3f-00df500e19ac" returned: 0 in 0.106s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Lock "cinder-quobyte-d82bec93-fc81-4ee8-be3f-00df500e19ac" released by "delete_volume" :: held 0.630s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:08 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Created reservations ['f07cd80f-c900-4e57-a557-a89849fb88f1', '662a17f1-8204-400c-8b95-0fa380280f95', '338dba2a-64b6-4686-a137-3028115da1ab', '01fa36cf-a5e2-4522-bb5c-9550b0ccc066'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:13:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.115s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:08 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:13:08 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Deleted volume successfully.
Sep 10 14:13:08 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-26ba791e-bab6-4528-87d0-c0566a522deb tempest-CinderUnicodeTest-1773309803 None] Lock "cinder-d82bec93-fc81-4ee8-be3f-00df500e19ac-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:18 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=60,cinder:UPDATE=89,cinder:DELETE=6,cinder:INSERT=24 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:13:18 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=59,cinder:UPDATE=87,cinder:DELETE=11,cinder:INSERT=21 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:13:27 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Flow 'volume_create_manager' (773649e6-fd0a-4716-a976-aaea83d03af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190ee374-cdd3-4c0b-990d-b5aa7abab731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:27 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Flow 'volume_create_manager' (1ed1f9da-1a34-45aa-812d-10d9c8de9d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4671c2-4f69-49d1-9f99-a8bc05016f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4671c2-4f69-49d1-9f99-a8bc05016f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1641835396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf8a86c-2ee3-470c-9ef2-d98e5a697af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8925d622167141b88c871c9663e3eb91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:27Z,use_quota=True,user_id='c7c9987cf3244fe08a20b8a00d26d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e287c9-a7b8-4ce3-9c7f-2e35cb03e45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e287c9-a7b8-4ce3-9c7f-2e35cb03e45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445fd4e3-07cb-4e33-9074-d118360c2066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445fd4e3-07cb-4e33-9074-d118360c2066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf8a86c-2ee3-470c-9ef2-d98e5a697af1', 'volume_name': 'volume-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064ffea6-125e-4ba2-ad3e-977cee91b9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064ffea6-125e-4ba2-ad3e-977cee91b9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f5a908-d2bb-47d6-9c58-b802d6f9954a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:27 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Volume 2bf8a86c-2ee3-470c-9ef2-d98e5a697af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1', 'volume_size': 1}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1641835396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf8a86c-2ee3-470c-9ef2-d98e5a697af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8925d622167141b88c871c9663e3eb91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:27Z,use_quota=True,user_id='c7c9987cf3244fe08a20b8a00d26d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Creating volume 2bf8a86c-2ee3-470c-9ef2-d98e5a697af1 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:13:27 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:13:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:28 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=146, name=volume-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:13:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190ee374-cdd3-4c0b-990d-b5aa7abab731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-584129406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f11af6-c6c0-4d07-83d9-818ed0844f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddbaaaa1fbf418db2ea647153d545b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:27Z,use_quota=True,user_id='dd2c4e5239f3462784cb922fc586e5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874a6da1-f25e-4891-81b5-c72ab97967b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874a6da1-f25e-4891-81b5-c72ab97967b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60920999-eaa9-4fef-9695-10e0f86c7857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60920999-eaa9-4fef-9695-10e0f86c7857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f11af6-c6c0-4d07-83d9-818ed0844f94', 'volume_name': 'volume-61f11af6-c6c0-4d07-83d9-818ed0844f94', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149c9f20-8623-4c63-bd86-094bc2c54ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149c9f20-8623-4c63-bd86-094bc2c54ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f8771c-97ba-4861-9c56-b0f63a9b7f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:28 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume 61f11af6-c6c0-4d07-83d9-818ed0844f94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f11af6-c6c0-4d07-83d9-818ed0844f94', 'volume_size': 1}
Sep 10 14:13:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1 1073741824" returned: 0 in 0.621s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1" returned: 0 in 0.637s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] <== create_volume: return (1342ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.880s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-584129406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f11af6-c6c0-4d07-83d9-818ed0844f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddbaaaa1fbf418db2ea647153d545b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:27Z,use_quota=True,user_id='dd2c4e5239f3462784cb922fc586e5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Creating volume 61f11af6-c6c0-4d07-83d9-818ed0844f94 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:13:29 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-61f11af6-c6c0-4d07-83d9-818ed0844f94 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:29 devstack quobyte-client[82845]: System call of process 99735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:13:29 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=147, name=volume-61f11af6-c6c0-4d07-83d9-818ed0844f94, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:13:29 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Flow 'volume_create_manager' (61cf1e94-e0a5-439a-88e7-9555700ace33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:29 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a7132a-9179-4f92-b8ce-d19d2d8576ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a7132a-9179-4f92-b8ce-d19d2d8576ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1223715662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fe108f-03da-4927-a07c-7e8233055371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8925d622167141b88c871c9663e3eb91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:29Z,use_quota=True,user_id='c7c9987cf3244fe08a20b8a00d26d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c1197f-9d5c-43d4-95c9-637e27291b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c1197f-9d5c-43d4-95c9-637e27291b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff50fb2-0ec3-4b37-8334-c688263dddec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff50fb2-0ec3-4b37-8334-c688263dddec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3fe108f-03da-4927-a07c-7e8233055371', 'volume_name': 'volume-a3fe108f-03da-4927-a07c-7e8233055371', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314f4ea6-c348-461f-bd95-219e019d66c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314f4ea6-c348-461f-bd95-219e019d66c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186ea84a-af60-4e0a-9275-7616452f06da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:30 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Volume a3fe108f-03da-4927-a07c-7e8233055371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3fe108f-03da-4927-a07c-7e8233055371', 'volume_size': 1}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f5a908-d2bb-47d6-9c58-b802d6f9954a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e875f6fb-a50f-4806-9b43-7719dc59a211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:30 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Flow 'volume_create_manager' (d41b1ba2-7542-40ef-9107-4ad98a181129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325e25c1-ad4d-42ce-8354-1594aa9e0579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:30 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Flow 'volume_create_manager' (da7de13a-10e1-4c8f-bd82-edc1f49b1c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5f2b41-0066-40b6-8f36-c95c285786a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-61f11af6-c6c0-4d07-83d9-818ed0844f94 1073741824" returned: 0 in 1.549s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:30 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5f2b41-0066-40b6-8f36-c95c285786a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1380271442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54268b9f-3f5e-4378-9ad9-005d94e88da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8925d622167141b88c871c9663e3eb91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:30Z,use_quota=True,user_id='c7c9987cf3244fe08a20b8a00d26d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d3de4d-beb8-4c80-8a01-26ce12fe4a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d3de4d-beb8-4c80-8a01-26ce12fe4a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc22f6d-3b35-462d-a2ab-00a4d369ff08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc22f6d-3b35-462d-a2ab-00a4d369ff08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54268b9f-3f5e-4378-9ad9-005d94e88da1', 'volume_name': 'volume-54268b9f-3f5e-4378-9ad9-005d94e88da1', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf318f6-28f2-4282-8d42-7fd8b08b8983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf318f6-28f2-4282-8d42-7fd8b08b8983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e17ef92-ca7b-4f43-9a00-c8a554fe7bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:31 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Volume 54268b9f-3f5e-4378-9ad9-005d94e88da1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54268b9f-3f5e-4378-9ad9-005d94e88da1', 'volume_size': 1}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325e25c1-ad4d-42ce-8354-1594aa9e0579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1348618355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1110480-a3a6-476c-b404-b7fe57b2d111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8925d622167141b88c871c9663e3eb91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:29Z,use_quota=True,user_id='c7c9987cf3244fe08a20b8a00d26d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da000e3-2c4d-43b0-9a9f-fbe45674f3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da000e3-2c4d-43b0-9a9f-fbe45674f3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f7a716-006c-4d9c-a689-e92df4831029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f7a716-006c-4d9c-a689-e92df4831029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1110480-a3a6-476c-b404-b7fe57b2d111', 'volume_name': 'volume-b1110480-a3a6-476c-b404-b7fe57b2d111', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe0a804-b8ab-4161-a7bc-2bad6fd53ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe0a804-b8ab-4161-a7bc-2bad6fd53ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c20d97e-8ae9-42bc-8538-7d089727d89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:31 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Volume b1110480-a3a6-476c-b404-b7fe57b2d111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1110480-a3a6-476c-b404-b7fe57b2d111', 'volume_size': 1}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-61f11af6-c6c0-4d07-83d9-818ed0844f94 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:31 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Volume volume-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1 (2bf8a86c-2ee3-470c-9ef2-d98e5a697af1): created successfully
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e875f6fb-a50f-4806-9b43-7719dc59a211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Flow 'volume_create_manager' (1ed1f9da-1a34-45aa-812d-10d9c8de9d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 1.189s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:31 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Flow 'volume_create_manager' (051a4797-4eba-482f-99c1-34bc9d03a21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71ea07a-2d5a-49e8-b5e1-62abab027a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:13:31 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-78f35feb-dae0-42af-b22b-a821f0ffd856 tempest-CreateVolumesFromImageTest-436680062 None] Created volume successfully.
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-61f11af6-c6c0-4d07-83d9-818ed0844f94" returned: 0 in 0.659s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71ea07a-2d5a-49e8-b5e1-62abab027a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-436570311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109e59f4-4770-41a3-9e39-d85adcf52946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8925d622167141b88c871c9663e3eb91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:30Z,use_quota=True,user_id='c7c9987cf3244fe08a20b8a00d26d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8143c4-980b-4095-a113-a318cf3f91ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8143c4-980b-4095-a113-a318cf3f91ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cdecb3-abc6-42c7-ae43-583e07e2cd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cdecb3-abc6-42c7-ae43-583e07e2cd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '109e59f4-4770-41a3-9e39-d85adcf52946', 'volume_name': 'volume-109e59f4-4770-41a3-9e39-d85adcf52946', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e0e759-1160-402a-9fc0-cd9af3e6bd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e0e759-1160-402a-9fc0-cd9af3e6bd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96154727-5b8a-4b8d-8b18-35675f7c440f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:31 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Volume 109e59f4-4770-41a3-9e39-d85adcf52946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-109e59f4-4770-41a3-9e39-d85adcf52946', 'volume_size': 1}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] <== create_volume: return (2412ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.423s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.245s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1223715662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fe108f-03da-4927-a07c-7e8233055371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8925d622167141b88c871c9663e3eb91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:29Z,use_quota=True,user_id='c7c9987cf3244fe08a20b8a00d26d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Creating volume a3fe108f-03da-4927-a07c-7e8233055371 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:13:31 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:13:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a3fe108f-03da-4927-a07c-7e8233055371 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:32 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=148, name=volume-a3fe108f-03da-4927-a07c-7e8233055371, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f8771c-97ba-4861-9c56-b0f63a9b7f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f11af6-c6c0-4d07-83d9-818ed0844f94', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5acbf8-559d-4e91-b4c3-be1212ac994d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:32 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume volume-61f11af6-c6c0-4d07-83d9-818ed0844f94 (61f11af6-c6c0-4d07-83d9-818ed0844f94): created successfully
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5acbf8-559d-4e91-b4c3-be1212ac994d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Flow 'volume_create_manager' (773649e6-fd0a-4716-a976-aaea83d03af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a3fe108f-03da-4927-a07c-7e8233055371 1073741824" returned: 0 in 0.504s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a3fe108f-03da-4927-a07c-7e8233055371 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:32 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a363c898-f732-4654-a7bf-4ec0071e20b0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Created volume successfully.
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a3fe108f-03da-4927-a07c-7e8233055371" returned: 0 in 0.366s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] <== create_volume: return (892ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.705s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1380271442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54268b9f-3f5e-4378-9ad9-005d94e88da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8925d622167141b88c871c9663e3eb91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:30Z,use_quota=True,user_id='c7c9987cf3244fe08a20b8a00d26d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Creating volume 54268b9f-3f5e-4378-9ad9-005d94e88da1 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:13:32 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:13:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-54268b9f-3f5e-4378-9ad9-005d94e88da1 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:32 devstack quobyte-client[82845]: System call of process 99744 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:13:32 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=149, name=volume-54268b9f-3f5e-4378-9ad9-005d94e88da1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:13:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186ea84a-af60-4e0a-9275-7616452f06da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3fe108f-03da-4927-a07c-7e8233055371', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45a1906-ea63-44ba-8397-d037552cc426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-54268b9f-3f5e-4378-9ad9-005d94e88da1 1073741824" returned: 0 in 0.494s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-54268b9f-3f5e-4378-9ad9-005d94e88da1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:33 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Volume volume-a3fe108f-03da-4927-a07c-7e8233055371 (a3fe108f-03da-4927-a07c-7e8233055371): created successfully
Sep 10 14:13:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45a1906-ea63-44ba-8397-d037552cc426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:33 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Flow 'volume_create_manager' (61cf1e94-e0a5-439a-88e7-9555700ace33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:33 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-2a51d1b9-54d2-4c57-a8fe-e37f08042f7c tempest-CreateVolumesFromImageTest-436680062 None] Created volume successfully.
Sep 10 14:13:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-54268b9f-3f5e-4378-9ad9-005d94e88da1" returned: 0 in 0.718s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] <== create_volume: return (1246ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:13:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.980s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1348618355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1110480-a3a6-476c-b404-b7fe57b2d111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8925d622167141b88c871c9663e3eb91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:29Z,use_quota=True,user_id='c7c9987cf3244fe08a20b8a00d26d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:13:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Creating volume b1110480-a3a6-476c-b404-b7fe57b2d111 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:13:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:34 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:13:34 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:13:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b1110480-a3a6-476c-b404-b7fe57b2d111 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:34 devstack quobyte-client[82845]: System call of process 99749 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:13:34 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=150, name=volume-b1110480-a3a6-476c-b404-b7fe57b2d111, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:13:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e17ef92-ca7b-4f43-9a00-c8a554fe7bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54268b9f-3f5e-4378-9ad9-005d94e88da1', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:34 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda9dc06-e08c-499f-9302-7318b1f76305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:34 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Flow 'volume_create_manager' (a3218bfe-3534-4287-8d6c-1717d0d09007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8c0248-8645-4675-b8a4-91c233e37e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:35 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Flow 'volume_create_manager' (67a4595d-28a0-4b2a-8ca9-32e2f18c3648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f31b39-28df-4c62-b090-b186d20ceada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8c0248-8645-4675-b8a4-91c233e37e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1609180165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ecccd5c-63c4-468c-981f-290f9020b8da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddbaaaa1fbf418db2ea647153d545b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:34Z,use_quota=True,user_id='dd2c4e5239f3462784cb922fc586e5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7672810-7995-49df-afc3-2e67a1b7d15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7672810-7995-49df-afc3-2e67a1b7d15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40eab9ca-dd41-4d09-bd7a-7185fea4bdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40eab9ca-dd41-4d09-bd7a-7185fea4bdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ecccd5c-63c4-468c-981f-290f9020b8da', 'volume_name': 'volume-8ecccd5c-63c4-468c-981f-290f9020b8da', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7e78ef-ee41-4562-a288-1490d068bd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7e78ef-ee41-4562-a288-1490d068bd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f40231-0900-4a39-9f2f-9f2028ec9af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:35 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume 8ecccd5c-63c4-468c-981f-290f9020b8da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ecccd5c-63c4-468c-981f-290f9020b8da', 'volume_size': 1}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f31b39-28df-4c62-b090-b186d20ceada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-640860204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6106126-e06c-44a7-9af9-18e7f05006dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddbaaaa1fbf418db2ea647153d545b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:34Z,use_quota=True,user_id='dd2c4e5239f3462784cb922fc586e5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4ea456-a317-4ef1-8270-1f69414b3c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4ea456-a317-4ef1-8270-1f69414b3c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af579bbc-6113-4b29-9c3f-5fb98b468fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af579bbc-6113-4b29-9c3f-5fb98b468fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6106126-e06c-44a7-9af9-18e7f05006dc', 'volume_name': 'volume-a6106126-e06c-44a7-9af9-18e7f05006dc', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd3e04e-3d3f-4630-8036-6e07a6bbd68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd3e04e-3d3f-4630-8036-6e07a6bbd68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7909451-054a-439a-b498-9c0ee2c4c819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:35 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume a6106126-e06c-44a7-9af9-18e7f05006dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6106126-e06c-44a7-9af9-18e7f05006dc', 'volume_size': 1}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:35 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Flow 'volume_create_manager' (a878bc22-f32a-4088-8870-4cf920fd2cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21f4aaf-820d-4ffc-9cf8-da948f722cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b1110480-a3a6-476c-b404-b7fe57b2d111 1073741824" returned: 0 in 1.422s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:35 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Volume volume-54268b9f-3f5e-4378-9ad9-005d94e88da1 (54268b9f-3f5e-4378-9ad9-005d94e88da1): created successfully
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda9dc06-e08c-499f-9302-7318b1f76305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Flow 'volume_create_manager' (da7de13a-10e1-4c8f-bd82-edc1f49b1c8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b1110480-a3a6-476c-b404-b7fe57b2d111 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21f4aaf-820d-4ffc-9cf8-da948f722cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-876436801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b702ffd-4c46-47a6-9e55-d6286960f40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddbaaaa1fbf418db2ea647153d545b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:35Z,use_quota=True,user_id='dd2c4e5239f3462784cb922fc586e5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ff5a98-c73a-4657-b554-47446dd8d4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ff5a98-c73a-4657-b554-47446dd8d4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b526ea-0111-4f27-a2c1-171a6dbd2cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b526ea-0111-4f27-a2c1-171a6dbd2cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b702ffd-4c46-47a6-9e55-d6286960f40a', 'volume_name': 'volume-7b702ffd-4c46-47a6-9e55-d6286960f40a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103ad225-bd47-4d5d-b056-b9b987386925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103ad225-bd47-4d5d-b056-b9b987386925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78345384-b222-44b4-a31d-2357eeee0d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:36 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume 7b702ffd-4c46-47a6-9e55-d6286960f40a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b702ffd-4c46-47a6-9e55-d6286960f40a', 'volume_size': 1}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:36 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Flow 'volume_create_manager' (6d64e0c1-2161-42b7-9a47-189e6a1d5c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c96d41a-0b77-4ab2-b82b-0873be21c2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:36 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-41dafbf1-bb6d-49a3-aeb7-a3e1dad83bed tempest-CreateVolumesFromImageTest-436680062 None] Created volume successfully.
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b1110480-a3a6-476c-b404-b7fe57b2d111" returned: 0 in 1.229s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] <== create_volume: return (2781ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.800s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.080s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-436570311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109e59f4-4770-41a3-9e39-d85adcf52946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8925d622167141b88c871c9663e3eb91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:30Z,use_quota=True,user_id='c7c9987cf3244fe08a20b8a00d26d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Creating volume 109e59f4-4770-41a3-9e39-d85adcf52946 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:13:36 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:13:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-109e59f4-4770-41a3-9e39-d85adcf52946 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:37 devstack quobyte-client[82845]: System call of process 99753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:13:37 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=151, name=volume-109e59f4-4770-41a3-9e39-d85adcf52946, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c96d41a-0b77-4ab2-b82b-0873be21c2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1094945878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddbaaaa1fbf418db2ea647153d545b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:35Z,use_quota=True,user_id='dd2c4e5239f3462784cb922fc586e5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396ef6aa-618b-4a31-bd28-b93ffe271e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396ef6aa-618b-4a31-bd28-b93ffe271e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37e5767-452d-4ea0-bfe8-65dd7e87e945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37e5767-452d-4ea0-bfe8-65dd7e87e945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a', 'volume_name': 'volume-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badd1033-e9b3-4387-9c75-23041d6fa526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badd1033-e9b3-4387-9c75-23041d6fa526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce059a6-b34f-411d-968d-e8eacf98a48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:37 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume 32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a', 'volume_size': 1}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:37 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Flow 'volume_create_manager' (8bf5d492-42f8-4cff-8080-2572feb5af22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a549b902-cb7f-4f09-bbb2-f07473e22141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a549b902-cb7f-4f09-bbb2-f07473e22141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1440103417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f86733-bc50-4c7a-a519-6ef3ca45d10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddbaaaa1fbf418db2ea647153d545b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:36Z,use_quota=True,user_id='dd2c4e5239f3462784cb922fc586e5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c86ec83-c207-4717-83b5-4d9af488c6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c86ec83-c207-4717-83b5-4d9af488c6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c92f2b7-a00b-4906-8c86-76c3542df941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c92f2b7-a00b-4906-8c86-76c3542df941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f86733-bc50-4c7a-a519-6ef3ca45d10d', 'volume_name': 'volume-c6f86733-bc50-4c7a-a519-6ef3ca45d10d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18bd8a0-8542-4636-8975-66fae35b45db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18bd8a0-8542-4636-8975-66fae35b45db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6914647b-7b4d-4a0e-9541-321117c88fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:37 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume c6f86733-bc50-4c7a-a519-6ef3ca45d10d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f86733-bc50-4c7a-a519-6ef3ca45d10d', 'volume_size': 1}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c20d97e-8ae9-42bc-8538-7d089727d89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1110480-a3a6-476c-b404-b7fe57b2d111', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb78643-4439-44a3-ace7-6dff3a797dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-109e59f4-4770-41a3-9e39-d85adcf52946 1073741824" returned: 0 in 0.841s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-109e59f4-4770-41a3-9e39-d85adcf52946 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:37 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Volume volume-b1110480-a3a6-476c-b404-b7fe57b2d111 (b1110480-a3a6-476c-b404-b7fe57b2d111): created successfully
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb78643-4439-44a3-ace7-6dff3a797dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:37 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Flow 'volume_create_manager' (d41b1ba2-7542-40ef-9107-4ad98a181129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:38 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-65b580a4-36fb-48ea-abe6-87c81951704d tempest-CreateVolumesFromImageTest-436680062 None] Created volume successfully.
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-109e59f4-4770-41a3-9e39-d85adcf52946" returned: 0 in 0.401s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] <== create_volume: return (1262ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.771s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1609180165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ecccd5c-63c4-468c-981f-290f9020b8da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddbaaaa1fbf418db2ea647153d545b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:34Z,use_quota=True,user_id='dd2c4e5239f3462784cb922fc586e5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Creating volume 8ecccd5c-63c4-468c-981f-290f9020b8da {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:13:38 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8ecccd5c-63c4-468c-981f-290f9020b8da 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:38 devstack quobyte-client[82845]: System call of process 99757 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:13:38 devstack quobyte-client[82845]: System call of process 99757 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:13:38 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=152, name=volume-8ecccd5c-63c4-468c-981f-290f9020b8da, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96154727-5b8a-4b8d-8b18-35675f7c440f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-109e59f4-4770-41a3-9e39-d85adcf52946', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec3538c-0720-4d44-994f-57f3fb6d4f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8ecccd5c-63c4-468c-981f-290f9020b8da 1073741824" returned: 0 in 0.627s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8ecccd5c-63c4-468c-981f-290f9020b8da {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:38 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Volume volume-109e59f4-4770-41a3-9e39-d85adcf52946 (109e59f4-4770-41a3-9e39-d85adcf52946): created successfully
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec3538c-0720-4d44-994f-57f3fb6d4f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Flow 'volume_create_manager' (051a4797-4eba-482f-99c1-34bc9d03a21a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8ecccd5c-63c4-468c-981f-290f9020b8da" returned: 0 in 0.393s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] <== create_volume: return (1046ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.805s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-640860204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6106126-e06c-44a7-9af9-18e7f05006dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddbaaaa1fbf418db2ea647153d545b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:34Z,use_quota=True,user_id='dd2c4e5239f3462784cb922fc586e5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Creating volume a6106126-e06c-44a7-9af9-18e7f05006dc {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:13:39 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a6106126-e06c-44a7-9af9-18e7f05006dc 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:39 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=153, name=volume-a6106126-e06c-44a7-9af9-18e7f05006dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:13:39 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-ee82dd5b-a70d-48fe-acd9-fb6ae25165d2 tempest-CreateVolumesFromImageTest-436680062 None] Created volume successfully.
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f40231-0900-4a39-9f2f-9f2028ec9af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ecccd5c-63c4-468c-981f-290f9020b8da', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb932c9-f016-4afb-be34-4c0bf7be1ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a6106126-e06c-44a7-9af9-18e7f05006dc 1073741824" returned: 0 in 0.597s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a6106126-e06c-44a7-9af9-18e7f05006dc {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "cinder-109e59f4-4770-41a3-9e39-d85adcf52946-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:40 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume volume-8ecccd5c-63c4-468c-981f-290f9020b8da (8ecccd5c-63c4-468c-981f-290f9020b8da): created successfully
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb932c9-f016-4afb-be34-4c0bf7be1ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Flow 'volume_create_manager' (a3218bfe-3534-4287-8d6c-1717d0d09007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a6106126-e06c-44a7-9af9-18e7f05006dc" returned: 0 in 0.531s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] <== create_volume: return (1156ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.115s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-876436801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b702ffd-4c46-47a6-9e55-d6286960f40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddbaaaa1fbf418db2ea647153d545b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:35Z,use_quota=True,user_id='dd2c4e5239f3462784cb922fc586e5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Creating volume 7b702ffd-4c46-47a6-9e55-d6286960f40a {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:13:40 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7b702ffd-4c46-47a6-9e55-d6286960f40a 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:40 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=154, name=volume-7b702ffd-4c46-47a6-9e55-d6286960f40a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:13:40 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-4f701a88-5f19-442d-bcbf-fc7db0cb9600 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Created volume successfully.
Sep 10 14:13:40 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-109e59f4-4770-41a3-9e39-d85adcf52946-delete_volume" acquired by "delete_volume" :: waited 0.730s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7909451-054a-439a-b498-9c0ee2c4c819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6106126-e06c-44a7-9af9-18e7f05006dc', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d2bff7-369d-4548-91ad-beb6e1242cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7b702ffd-4c46-47a6-9e55-d6286960f40a 1073741824" returned: 0 in 0.666s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7b702ffd-4c46-47a6-9e55-d6286960f40a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:41 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume volume-a6106126-e06c-44a7-9af9-18e7f05006dc (a6106126-e06c-44a7-9af9-18e7f05006dc): created successfully
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d2bff7-369d-4548-91ad-beb6e1242cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Flow 'volume_create_manager' (67a4595d-28a0-4b2a-8ca9-32e2f18c3648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:41 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "cinder-quobyte-109e59f4-4770-41a3-9e39-d85adcf52946" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:41 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-e92c17c6-2ef6-463e-8327-b6134d39f16d tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Created volume successfully.
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7b702ffd-4c46-47a6-9e55-d6286960f40a" returned: 0 in 0.651s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] <== create_volume: return (1341ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-quobyte-109e59f4-4770-41a3-9e39-d85adcf52946" acquired by "delete_volume" :: waited 0.121s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.581s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1094945878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddbaaaa1fbf418db2ea647153d545b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:35Z,use_quota=True,user_id='dd2c4e5239f3462784cb922fc586e5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Creating volume 32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:13:41 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:13:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:42 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=155, name=volume-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:13:42 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d1262f-4cae-4ec3-868c-816df0397f00]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:13:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78345384-b222-44b4-a31d-2357eeee0d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b702ffd-4c46-47a6-9e55-d6286960f40a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e01459-be2c-4834-a546-bf964e09c7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-109e59f4-4770-41a3-9e39-d85adcf52946 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:42 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume volume-7b702ffd-4c46-47a6-9e55-d6286960f40a (7b702ffd-4c46-47a6-9e55-d6286960f40a): created successfully
Sep 10 14:13:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e01459-be2c-4834-a546-bf964e09c7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Flow 'volume_create_manager' (a878bc22-f32a-4088-8870-4cf920fd2cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a 1073741824" returned: 0 in 0.882s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:42 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-3e1b9661-8367-47cd-b5b1-21a14e87c322 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Created volume successfully.
Sep 10 14:13:42 devstack quobyte-client[82845]: System call of process 99772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a" returned: 0 in 0.334s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] <== create_volume: return (1236ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.457s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1440103417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f86733-bc50-4c7a-a519-6ef3ca45d10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ddbaaaa1fbf418db2ea647153d545b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:13:36Z,use_quota=True,user_id='dd2c4e5239f3462784cb922fc586e5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Creating volume c6f86733-bc50-4c7a-a519-6ef3ca45d10d {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:13:43 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c6f86733-bc50-4c7a-a519-6ef3ca45d10d 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-109e59f4-4770-41a3-9e39-d85adcf52946" returned: 0 in 0.967s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:43 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=156, name=volume-c6f86733-bc50-4c7a-a519-6ef3ca45d10d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce059a6-b34f-411d-968d-e8eacf98a48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9d3918-2ae0-4bad-9dbb-f0a44371aadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-109e59f4-4770-41a3-9e39-d85adcf52946 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:43 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume volume-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a (32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a): created successfully
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9d3918-2ae0-4bad-9dbb-f0a44371aadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Flow 'volume_create_manager' (6d64e0c1-2161-42b7-9a47-189e6a1d5c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-109e59f4-4770-41a3-9e39-d85adcf52946" returned: 0 in 0.382s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c6f86733-bc50-4c7a-a519-6ef3ca45d10d 1073741824" returned: 0 in 0.863s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:44 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-7fc3dee6-01b6-4b9a-82c3-34c01a2c9c3e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Created volume successfully.
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c6f86733-bc50-4c7a-a519-6ef3ca45d10d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-quobyte-109e59f4-4770-41a3-9e39-d85adcf52946" released by "delete_volume" :: held 2.413s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c6f86733-bc50-4c7a-a519-6ef3ca45d10d" returned: 0 in 0.377s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] <== create_volume: return (1311ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6914647b-7b4d-4a0e-9541-321117c88fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f86733-bc50-4c7a-a519-6ef3ca45d10d', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915ec636-a7f7-412e-89b1-502bfbf487ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:13:44 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume volume-c6f86733-bc50-4c7a-a519-6ef3ca45d10d (c6f86733-bc50-4c7a-a519-6ef3ca45d10d): created successfully
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915ec636-a7f7-412e-89b1-502bfbf487ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Flow 'volume_create_manager' (8bf5d492-42f8-4cff-8080-2572feb5af22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Created reservations ['646ad117-7bde-4e6e-b297-6ae4ee87512a', 'aadfcbe2-958b-431c-8d71-1512b935bda4', '8aadac18-8828-4dff-a3ad-78614fb7273e', '7b68bbe9-0363-49ad-a837-fffec459690a'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:13:44 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-ce497718-3d42-472f-b893-bb85ae79befa tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Created volume successfully.
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.120s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:45 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:13:45 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Deleted volume successfully.
Sep 10 14:13:45 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-56d43d11-a893-4764-969c-8ae49e63cc1a tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-109e59f4-4770-41a3-9e39-d85adcf52946-delete_volume" released by "delete_volume" :: held 4.478s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:45 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "cinder-c6f86733-bc50-4c7a-a519-6ef3ca45d10d-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:45 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "cinder-54268b9f-3f5e-4378-9ad9-005d94e88da1-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:45 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-c6f86733-bc50-4c7a-a519-6ef3ca45d10d-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:45 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-54268b9f-3f5e-4378-9ad9-005d94e88da1-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:45 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:45 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "cinder-quobyte-c6f86733-bc50-4c7a-a519-6ef3ca45d10d" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-quobyte-c6f86733-bc50-4c7a-a519-6ef3ca45d10d" acquired by "delete_volume" :: waited 0.010s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:46 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f8dad5-c3d1-4f44-9c95-e9bf4d190569]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:13:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c6f86733-bc50-4c7a-a519-6ef3ca45d10d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:46 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "cinder-quobyte-54268b9f-3f5e-4378-9ad9-005d94e88da1" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-quobyte-54268b9f-3f5e-4378-9ad9-005d94e88da1" acquired by "delete_volume" :: waited 0.143s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:46 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6f25cd-1289-457e-b2ac-1fe5d89098d6]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:13:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-54268b9f-3f5e-4378-9ad9-005d94e88da1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c6f86733-bc50-4c7a-a519-6ef3ca45d10d" returned: 0 in 0.657s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c6f86733-bc50-4c7a-a519-6ef3ca45d10d {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-c6f86733-bc50-4c7a-a519-6ef3ca45d10d" returned: 0 in 0.284s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-quobyte-c6f86733-bc50-4c7a-a519-6ef3ca45d10d" released by "delete_volume" :: held 1.171s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-54268b9f-3f5e-4378-9ad9-005d94e88da1" returned: 0 in 0.908s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-54268b9f-3f5e-4378-9ad9-005d94e88da1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-54268b9f-3f5e-4378-9ad9-005d94e88da1" returned: 0 in 0.300s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-quobyte-54268b9f-3f5e-4378-9ad9-005d94e88da1" released by "delete_volume" :: held 1.373s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:47 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Created reservations ['e29e17db-a9b5-4cf6-af16-2bf6095db845', '05a8e5e9-5fdb-4f90-bbdd-e94ac6f3410e', 'ad5cac9a-3200-42c9-a304-dacc82013816', '85007654-2532-42f3-bf62-fcbbdd54d2a3'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:13:47 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Created reservations ['69a68983-7d5f-4e57-a4a1-617d4f2d7cef', '6a4b0282-f632-4fb9-88f4-edd569316cae', 'dbee9046-05ef-40e0-9be7-37abef692c33', '4ea0f28c-a2e0-403b-93f4-2dfb853cf404'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "cinder-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "cinder-b1110480-a3a6-476c-b404-b7fe57b2d111-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a-delete_volume" acquired by "delete_volume" :: waited 0.306s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-b1110480-a3a6-476c-b404-b7fe57b2d111-delete_volume" acquired by "delete_volume" :: waited 0.370s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.810s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:48 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:13:48 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Deleted volume successfully.
Sep 10 14:13:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.439s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:49 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:13:49 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Deleted volume successfully.
Sep 10 14:13:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3263113b-08ba-4ce9-a63a-29d7e417b18e tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-c6f86733-bc50-4c7a-a519-6ef3ca45d10d-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:49 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "cinder-quobyte-b1110480-a3a6-476c-b404-b7fe57b2d111" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-740a9c35-59c0-4c77-8833-7f381b9d07a7 tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-54268b9f-3f5e-4378-9ad9-005d94e88da1-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-quobyte-b1110480-a3a6-476c-b404-b7fe57b2d111" acquired by "delete_volume" :: waited 0.068s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:49 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2234ba-efbc-4de8-ac49-c2cd588bf100]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:13:49 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "cinder-quobyte-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b1110480-a3a6-476c-b404-b7fe57b2d111 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-quobyte-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a" acquired by "delete_volume" :: waited 0.366s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:49 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79acf87-c754-417a-a137-680de6739908]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:13:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b1110480-a3a6-476c-b404-b7fe57b2d111" returned: 0 in 0.686s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b1110480-a3a6-476c-b404-b7fe57b2d111 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-b1110480-a3a6-476c-b404-b7fe57b2d111" returned: 0 in 0.185s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:50 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-quobyte-b1110480-a3a6-476c-b404-b7fe57b2d111" released by "delete_volume" :: held 1.128s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a" returned: 0 in 0.866s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a" returned: 0 in 0.321s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:51 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-quobyte-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a" released by "delete_volume" :: held 1.406s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:51 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Created reservations ['51883963-25e0-4a42-922d-6ffd4ed29437', '5dd6a4a9-bad8-4364-b9cb-f356b5beacaf', '71ff7e04-78cf-4726-ada6-16ab1102f142', '0a2704f4-49e1-4d11-aeb5-a7ec09aeb7e1'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:13:51 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Created reservations ['c7278692-80d1-4fbe-a338-cdf788a81126', 'b35ccc14-288e-4915-ada2-ae7402988aa9', '10d44bc7-7ce2-4d3c-9da9-2ee545737c4f', 'e7646a8c-f175-4ceb-b92a-161c82487615'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:13:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:51 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.396s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:51 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:13:51 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Deleted volume successfully.
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "cinder-a3fe108f-03da-4927-a07c-7e8233055371-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "cinder-7b702ffd-4c46-47a6-9e55-d6286960f40a-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-f64e6bcb-221f-4e1a-8914-00f1f7eb59f1 tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-b1110480-a3a6-476c-b404-b7fe57b2d111-delete_volume" released by "delete_volume" :: held 3.194s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-a3fe108f-03da-4927-a07c-7e8233055371-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-7b702ffd-4c46-47a6-9e55-d6286960f40a-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:52 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "cinder-quobyte-a3fe108f-03da-4927-a07c-7e8233055371" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:52 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "cinder-quobyte-7b702ffd-4c46-47a6-9e55-d6286960f40a" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.475s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-quobyte-a3fe108f-03da-4927-a07c-7e8233055371" acquired by "delete_volume" :: waited 0.111s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:52 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Deleted volume successfully.
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19cfbe4-accb-40aa-b52b-d1b3b826e46f]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a3fe108f-03da-4927-a07c-7e8233055371 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-quobyte-7b702ffd-4c46-47a6-9e55-d6286960f40a" acquired by "delete_volume" :: waited 0.242s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:53 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12a50f9-c44b-4400-9db2-7414e2902754]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:13:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7b702ffd-4c46-47a6-9e55-d6286960f40a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e1862cdd-b71c-4a97-92ad-30a15102a62a tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-32ffb22f-7c2c-4c2c-ba53-1fd733b9cc1a-delete_volume" released by "delete_volume" :: held 4.482s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a3fe108f-03da-4927-a07c-7e8233055371" returned: 0 in 0.697s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a3fe108f-03da-4927-a07c-7e8233055371 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a3fe108f-03da-4927-a07c-7e8233055371" returned: 0 in 0.193s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-quobyte-a3fe108f-03da-4927-a07c-7e8233055371" released by "delete_volume" :: held 1.069s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7b702ffd-4c46-47a6-9e55-d6286960f40a" returned: 0 in 0.914s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:53 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7b702ffd-4c46-47a6-9e55-d6286960f40a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-7b702ffd-4c46-47a6-9e55-d6286960f40a" returned: 0 in 0.243s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-quobyte-7b702ffd-4c46-47a6-9e55-d6286960f40a" released by "delete_volume" :: held 1.438s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:54 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Created reservations ['fd426746-55d0-4b0c-b7b6-8b5f86c12864', 'faf37d67-219c-4853-a85c-c47626c0d48a', '3ac664c4-848e-42bb-a4b7-394ae8c7ebb8', '68a40d04-2b64-4d75-8b49-0179827df42b'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:13:54 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Created reservations ['667ffa5e-4dd2-40f7-a278-9c286e2d4ca3', '0e17b802-6186-44b3-80ff-ec3cf455c6e2', 'fb90e4a6-2fdd-45df-abab-89cff31c03d7', 'bb12ee81-ff72-4689-829b-79dfdf23849a'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:13:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:54 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:54 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.223s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:54 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:13:54 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Deleted volume successfully.
Sep 10 14:13:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:55 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7199a656-35df-466f-a961-0db474a15d36 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-7b702ffd-4c46-47a6-9e55-d6286960f40a-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:55 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "cinder-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:55 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "cinder-8ecccd5c-63c4-468c-981f-290f9020b8da-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.535s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:55 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:55 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:13:55 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-8ecccd5c-63c4-468c-981f-290f9020b8da-delete_volume" acquired by "delete_volume" :: waited 0.203s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:55 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Deleted volume successfully.
Sep 10 14:13:55 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-6529eb4e-a157-4348-8828-ee8f7ee252c9 tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-a3fe108f-03da-4927-a07c-7e8233055371-delete_volume" released by "delete_volume" :: held 3.774s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:55 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:56 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "cinder-quobyte-8ecccd5c-63c4-468c-981f-290f9020b8da" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:56 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:56 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "cinder-quobyte-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:56 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-quobyte-8ecccd5c-63c4-468c-981f-290f9020b8da" acquired by "delete_volume" :: waited 0.056s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:56 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-quobyte-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1" acquired by "delete_volume" :: waited 0.030s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:56 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f33c08d-4d58-454f-8bd4-d2ced968b216]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:13:56 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb39a635-4715-420a-b5a0-abc15a0b2a69]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:13:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8ecccd5c-63c4-468c-981f-290f9020b8da {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8ecccd5c-63c4-468c-981f-290f9020b8da" returned: 0 in 0.655s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8ecccd5c-63c4-468c-981f-290f9020b8da {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1" returned: 0 in 0.709s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-8ecccd5c-63c4-468c-981f-290f9020b8da" returned: 0 in 0.238s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1" returned: 0 in 0.226s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-quobyte-8ecccd5c-63c4-468c-981f-290f9020b8da" released by "delete_volume" :: held 1.103s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-quobyte-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1" released by "delete_volume" :: held 1.234s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:57 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Created reservations ['0846b668-a0b4-45f0-838f-3f45f8d77778', '20466798-e0ae-426d-89d6-4804d120c717', '72b2151a-7f63-4ae4-ab46-a6e4efdcc0a3', '33522947-8f11-4fd5-b0cf-1b3dd90f484b'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:13:57 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Created reservations ['bcdd7f11-085c-4553-a271-8d08fd5cb7e1', 'ae1c3c95-227b-40f8-97d8-e180b94556bb', '2370a86a-988f-405f-a00a-a66038c6ee13', '312eaf06-0a50-4202-8168-fc18f9917b1f'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:13:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:58 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "cinder-a6106126-e06c-44a7-9af9-18e7f05006dc-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.749s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:58 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:13:58 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Deleted volume successfully.
Sep 10 14:13:58 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-a6106126-e06c-44a7-9af9-18e7f05006dc-delete_volume" acquired by "delete_volume" :: waited 0.366s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:13:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:13:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:13:58 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:13:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:13:58 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1e91a009-a1ec-4151-aec5-cb0c53f2dc6f tempest-CreateVolumesFromImageTest-436680062 None] Lock "cinder-2bf8a86c-2ee3-470c-9ef2-d98e5a697af1-delete_volume" released by "delete_volume" :: held 3.510s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:13:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.561s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:13:59 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:13:59 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:13:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "cinder-quobyte-a6106126-e06c-44a7-9af9-18e7f05006dc" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:13:59 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Deleted volume successfully.
Sep 10 14:13:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-quobyte-a6106126-e06c-44a7-9af9-18e7f05006dc" acquired by "delete_volume" :: waited 0.034s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:13:59 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86e65f0-d9f0-4d90-9188-2a45acdd30aa]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:13:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a6106126-e06c-44a7-9af9-18e7f05006dc {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:13:59 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-18da8bd7-ba63-4f4a-b0fb-079146d3dfb0 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-8ecccd5c-63c4-468c-981f-290f9020b8da-delete_volume" released by "delete_volume" :: held 3.943s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a6106126-e06c-44a7-9af9-18e7f05006dc" returned: 0 in 0.601s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a6106126-e06c-44a7-9af9-18e7f05006dc {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a6106126-e06c-44a7-9af9-18e7f05006dc" returned: 0 in 0.126s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:00 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-quobyte-a6106126-e06c-44a7-9af9-18e7f05006dc" released by "delete_volume" :: held 0.892s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:00 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Created reservations ['519e0d1d-7d84-4c7f-8ad0-e786cd4b2903', '7db4ac80-95ea-42cf-9065-1e8552f53991', 'd169db15-9cd0-47a9-aff9-d94c0eb49412', 'c8143669-07a1-4480-87c5-0ace79dfac21'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:14:00 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:00 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:14:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Flow 'volume_create_manager' (7998c8e3-74f9-4085-8505-098f7645ef95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5850b52-d660-4b38-8d35-3bef9a2cb29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5850b52-d660-4b38-8d35-3bef9a2cb29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-924867054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6ee4fa-411d-431f-8035-453b1f259821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324d926d5e7549b8945593aa6bc368f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:01Z,use_quota=True,user_id='ef47fbb5c65f4b518a128834d80cfef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c189952-f8ee-4550-b5c5-82877a5fda36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c189952-f8ee-4550-b5c5-82877a5fda36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536b4657-e5eb-449c-9276-2b7aacbca36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536b4657-e5eb-449c-9276-2b7aacbca36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af6ee4fa-411d-431f-8035-453b1f259821', 'volume_name': 'volume-af6ee4fa-411d-431f-8035-453b1f259821', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0c0b23-e673-4ce6-bc22-12978395e880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0c0b23-e673-4ce6-bc22-12978395e880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5c2128-6c9c-4e56-903e-61e99734057f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:01 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Volume af6ee4fa-411d-431f-8035-453b1f259821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af6ee4fa-411d-431f-8035-453b1f259821', 'volume_size': 1}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-924867054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6ee4fa-411d-431f-8035-453b1f259821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324d926d5e7549b8945593aa6bc368f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:01Z,use_quota=True,user_id='ef47fbb5c65f4b518a128834d80cfef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Creating volume af6ee4fa-411d-431f-8035-453b1f259821 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:14:01 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:01 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=157, name=volume-af6ee4fa-411d-431f-8035-453b1f259821, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821 1073741824" returned: 0 in 0.605s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.312s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:01 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:14:01 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Deleted volume successfully.
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "cinder-61f11af6-c6c0-4d07-83d9-818ed0844f94-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821" returned: 0 in 0.463s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] <== create_volume: return (1115ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-8e6d4215-d3e6-469e-8a2f-b65054b24454 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-a6106126-e06c-44a7-9af9-18e7f05006dc-delete_volume" released by "delete_volume" :: held 3.586s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-61f11af6-c6c0-4d07-83d9-818ed0844f94-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5c2128-6c9c-4e56-903e-61e99734057f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af6ee4fa-411d-431f-8035-453b1f259821', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adce627d-1611-47a5-bfa4-663a147c606c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:02 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Volume volume-af6ee4fa-411d-431f-8035-453b1f259821 (af6ee4fa-411d-431f-8035-453b1f259821): created successfully
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adce627d-1611-47a5-bfa4-663a147c606c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Flow 'volume_create_manager' (7998c8e3-74f9-4085-8505-098f7645ef95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:02 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-ac5c07d4-9ada-4c45-9517-87e6cc495cb1 tempest-SnapshotDependencyTests-1545310328 None] Created volume successfully.
Sep 10 14:14:02 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "cinder-quobyte-61f11af6-c6c0-4d07-83d9-818ed0844f94" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-quobyte-61f11af6-c6c0-4d07-83d9-818ed0844f94" acquired by "delete_volume" :: waited 0.012s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[0616c345-5f88-4a61-b51d-e177d9f552a1]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-61f11af6-c6c0-4d07-83d9-818ed0844f94 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:02 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Flow 'volume_create_manager' (07ecb095-b21b-4aa7-ac8e-30c48ad9c707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:02 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f744d41a-a98a-4f09-b335-4ecf6a9bd5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-61f11af6-c6c0-4d07-83d9-818ed0844f94" returned: 0 in 0.651s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f744d41a-a98a-4f09-b335-4ecf6a9bd5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-487798490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55013a94-5728-42f1-b88d-19059c096437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94507ada92747d7b4af368743a09590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:02Z,use_quota=True,user_id='7c44448e430f47dfa723440f0e5c0e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6393847-fd8a-4eff-83a7-e1aff6a42e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6393847-fd8a-4eff-83a7-e1aff6a42e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ed6e42-b367-4eb1-907a-014edb4d3da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ed6e42-b367-4eb1-907a-014edb4d3da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55013a94-5728-42f1-b88d-19059c096437', 'volume_name': 'volume-55013a94-5728-42f1-b88d-19059c096437', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c793bf8-adb1-479c-b5ae-4e69102a51bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c793bf8-adb1-479c-b5ae-4e69102a51bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6dc868-0c39-4755-8862-52559e1ba4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:03 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume 55013a94-5728-42f1-b88d-19059c096437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55013a94-5728-42f1-b88d-19059c096437', 'volume_size': 1}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-487798490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55013a94-5728-42f1-b88d-19059c096437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94507ada92747d7b4af368743a09590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:02Z,use_quota=True,user_id='7c44448e430f47dfa723440f0e5c0e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Creating volume 55013a94-5728-42f1-b88d-19059c096437 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:14:03 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-61f11af6-c6c0-4d07-83d9-818ed0844f94 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:03 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=158, name=volume-55013a94-5728-42f1-b88d-19059c096437, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437 1073741824" returned: 0 in 0.505s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-61f11af6-c6c0-4d07-83d9-818ed0844f94" returned: 0 in 0.437s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:03 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:03 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-quobyte-61f11af6-c6c0-4d07-83d9-818ed0844f94" released by "delete_volume" :: held 1.501s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437" returned: 0 in 0.355s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:04 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] <== create_volume: return (890ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:14:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.188s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:04 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6dc868-0c39-4755-8862-52559e1ba4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55013a94-5728-42f1-b88d-19059c096437', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:04 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c245e30b-4704-4ab1-8860-ff5ee9dd292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:04 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] Creating offline snapshot c486e304-dc2d-4957-95fa-974d9c7110e1 of volume af6ee4fa-411d-431f-8035-453b1f259821 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:14:04 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a3b21f-ac3a-49e2-a4b5-49e91a84141e]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:04 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume volume-55013a94-5728-42f1-b88d-19059c096437 (55013a94-5728-42f1-b88d-19059c096437): created successfully
Sep 10 14:14:04 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c245e30b-4704-4ab1-8860-ff5ee9dd292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:04 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Flow 'volume_create_manager' (07ecb095-b21b-4aa7-ac8e-30c48ad9c707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:04 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-46ed2536-83e9-4ea0-adab-f0994bab7d1f tempest-CreateVolumesFromSnapshotTest-266245230 None] Created volume successfully.
Sep 10 14:14:04 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Created reservations ['fc492066-6ffa-4c3a-8b13-d4f6900f043d', '9593b647-6fe9-4cfc-871b-6295839a5a83', '661a6352-d677-4638-83be-ceb75d395d6f', '395e95e1-0154-45c8-9df2-493c1367351f'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:14:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821" returned: 0 in 0.609s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:04 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:05 devstack quobyte-client[82845]: System call of process 99848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:05 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=159, name=volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:14:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:05 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:05 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1 1G" returned: 0 in 0.861s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): qemu-img rebase -u -b volume-af6ee4fa-411d-431f-8035-453b1f259821 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:05 devstack quobyte-client[82845]: System call of process 99852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:05 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.322s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:05 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:14:05 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Deleted volume successfully.
Sep 10 14:14:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] CMD "qemu-img rebase -u -b volume-af6ee4fa-411d-431f-8035-453b1f259821 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1" returned: 0 in 0.369s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:14:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1" returned: 0 in 0.250s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:14:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-35b1ece0-d77f-46a7-8e41-1240fbf47631 tempest-CreateVolumesFromSourceVolumeTest-171646495 None] Lock "cinder-61f11af6-c6c0-4d07-83d9-818ed0844f94-delete_volume" released by "delete_volume" :: held 4.270s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1" returned: 0 in 0.228s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.info" returned: 0 in 0.117s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:14:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.info" returned: 0 in 0.101s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.846s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.347s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:07 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] Creating offline snapshot b6142b1e-94da-48bc-be06-4849c8be5932 of volume 55013a94-5728-42f1-b88d-19059c096437 {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:14:07 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[933dfb67-5ada-42ff-b478-6a5375a8b74e]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:07 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a1d32381-ec21-4b8e-83db-0257cdfb86ba tempest-SnapshotDependencyTests-1545310328 None] Create snapshot completed successfully
Sep 10 14:14:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437" returned: 0 in 0.574s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:08 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=161, name=volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:14:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932 1G" returned: 0 in 0.277s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): qemu-img rebase -u -b volume-55013a94-5728-42f1-b88d-19059c096437 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:08 devstack quobyte-client[82845]: System call of process 99865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "qemu-img rebase -u -b volume-55013a94-5728-42f1-b88d-19059c096437 -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932" returned: 0 in 0.368s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:14:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:08 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:08 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:14:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932" returned: 0 in 0.404s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:08 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437 -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:14:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Flow 'volume_create_manager' (53c7f6e6-36d5-4bfd-a0b0-33292922db00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd14167-8904-43be-b414-f17e0644262c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932" returned: 0 in 0.478s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd14167-8904-43be-b414-f17e0644262c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8a8584-0dbd-4212-a11e-50b470bd951f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324d926d5e7549b8945593aa6bc368f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c486e304-dc2d-4957-95fa-974d9c7110e1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:08Z,use_quota=True,user_id='ef47fbb5c65f4b518a128834d80cfef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bd8261-e874-49a3-b406-48a48da6f8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bd8261-e874-49a3-b406-48a48da6f8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2167ecf4-89e5-45b6-a534-a7d13d50e83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2167ecf4-89e5-45b6-a534-a7d13d50e83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d8a8584-0dbd-4212-a11e-50b470bd951f', 'volume_name': 'volume-2d8a8584-0dbd-4212-a11e-50b470bd951f', 'volume_size': 1, 'snapshot_id': 'c486e304-dc2d-4957-95fa-974d9c7110e1'}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dfd025-a082-4cf6-a1f9-5fd212c033dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dfd025-a082-4cf6-a1f9-5fd212c033dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76292f8a-18d2-4abf-b379-258c7e3b438a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:09 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Volume 2d8a8584-0dbd-4212-a11e-50b470bd951f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d8a8584-0dbd-4212-a11e-50b470bd951f', 'volume_size': 1, 'snapshot_id': 'c486e304-dc2d-4957-95fa-974d9c7110e1'}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.info" returned: 0 in 0.445s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:14:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.info" returned: 0 in 0.102s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.069s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.370s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "cinder-quobyte-c486e304-dc2d-4957-95fa-974d9c7110e1-2d8a8584-0dbd-4212-a11e-50b470bd951f" by "_create_volume_from_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:10 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-4cb4b012-d15d-4bed-9125-6d64e0e72102 tempest-CreateVolumesFromSnapshotTest-266245230 None] Create snapshot completed successfully
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-quobyte-c486e304-dc2d-4957-95fa-974d9c7110e1-2d8a8584-0dbd-4212-a11e-50b470bd951f" acquired by "_create_volume_from_snapshot" :: waited 0.152s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Creating volume 2d8a8584-0dbd-4212-a11e-50b470bd951f from snapshot c486e304-dc2d-4957-95fa-974d9c7110e1 {{(pid=82823) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "cinder-quobyte-2d8a8584-0dbd-4212-a11e-50b470bd951f" by "_copy_volume_from_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-quobyte-2d8a8584-0dbd-4212-a11e-50b470bd951f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] snapshot: c486e304-dc2d-4957-95fa-974d9c7110e1, volume: 2d8a8584-0dbd-4212-a11e-50b470bd951f,  {{(pid=82823) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93c6b8c-ee02-4eed-97c5-626f93947166]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1" returned: 0 in 0.442s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af6ee4fa-411d-431f-8035-453b1f259821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:14:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821 {{(pid=82823) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 14:14:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Creating direct copy from snapshot {{(pid=82823) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 14:14:11 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[476f431b-c5b3-4616-9b2e-952410b9bbac]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:11 devstack quobyte-client[82845]: System call of process 99875 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821" returned: 0 in 0.543s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:11 devstack cinder-volume[82823]: DEBUG cinder.utils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2d8a8584-0dbd-4212-a11e-50b470bd951f not found in is_blk_device check {{(pid=82823) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 14:14:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2d8a8584-0dbd-4212-a11e-50b470bd951f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:11 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=163, name=volume-2d8a8584-0dbd-4212-a11e-50b470bd951f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:14:12 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:12 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:14:13 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Flow 'volume_create_manager' (710b4e72-6bad-4d72-972e-a02501543be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:13 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487591e5-3558-49b0-9ff4-97651ac91ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:13 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:13 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:14:13 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Flow 'volume_create_manager' (53163a11-37fd-4f91-b324-666b9a9ee164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:13 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7c1004-428a-4ac4-8f75-fb8bc1da034a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487591e5-3558-49b0-9ff4-97651ac91ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1476499194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329de748-a52e-4437-a281-a04ad573493c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94507ada92747d7b4af368743a09590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:12Z,use_quota=True,user_id='7c44448e430f47dfa723440f0e5c0e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d876d168-514a-4c9d-a55e-e7d73c98f49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d876d168-514a-4c9d-a55e-e7d73c98f49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb9700c-ac1d-47f0-99aa-90a29b8386c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb9700c-ac1d-47f0-99aa-90a29b8386c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '329de748-a52e-4437-a281-a04ad573493c', 'volume_name': 'volume-329de748-a52e-4437-a281-a04ad573493c', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e71bfd-3741-419e-972c-7c6db77aedb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e71bfd-3741-419e-972c-7c6db77aedb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104b2ea6-c784-4bdf-bf72-7289e85091f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:14 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume 329de748-a52e-4437-a281-a04ad573493c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-329de748-a52e-4437-a281-a04ad573493c', 'volume_size': 1}
Sep 10 14:14:14 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7c1004-428a-4ac4-8f75-fb8bc1da034a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e190e6-ac33-477e-b774-52d34591155c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2beb185995b49f1bcfbc0c309d6b226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:12Z,use_quota=True,user_id='1e60dcf8012a45049013519ecd0e5680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160376c0-715d-4284-a873-ae8b6650dd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160376c0-715d-4284-a873-ae8b6650dd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:14 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d395073-4971-4097-ad54-ca6f4cba6c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:15 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:15 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:14:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Flow 'volume_create_manager' (2bfeecad-9aec-424a-99ed-f1b3f184add6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926ef4f1-2517-4ac0-abdd-ac68825ee84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926ef4f1-2517-4ac0-abdd-ac68825ee84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-874495663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddac40f2-d5ef-462d-80a8-1b39acfab372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94507ada92747d7b4af368743a09590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:13Z,use_quota=True,user_id='7c44448e430f47dfa723440f0e5c0e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44403cf-06cd-4af2-997b-381aa42e31e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44403cf-06cd-4af2-997b-381aa42e31e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad19c51d-d834-4ec4-9674-29c445d289bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad19c51d-d834-4ec4-9674-29c445d289bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddac40f2-d5ef-462d-80a8-1b39acfab372', 'volume_name': 'volume-ddac40f2-d5ef-462d-80a8-1b39acfab372', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd65d5d-5ee1-469c-8bd5-66e5558c7923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd65d5d-5ee1-469c-8bd5-66e5558c7923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:15 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa12cafe-b938-4d9a-99c4-b5461381a2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:15 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume ddac40f2-d5ef-462d-80a8-1b39acfab372: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddac40f2-d5ef-462d-80a8-1b39acfab372', 'volume_size': 1}
Sep 10 14:14:15 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:16 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:16 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:14:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Flow 'volume_create_manager' (2fad34e4-8d44-4352-9838-d9920df9ee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82024422-2e4b-4b0e-9f61-73f32101e3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82024422-2e4b-4b0e-9f61-73f32101e3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1173318220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cdd4694-57df-4f36-b14c-24224335395a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94507ada92747d7b4af368743a09590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:15Z,use_quota=True,user_id='7c44448e430f47dfa723440f0e5c0e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c09fa94-fd73-4a0f-96e6-9c08617f8b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c09fa94-fd73-4a0f-96e6-9c08617f8b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d448902-5c9c-4884-8e51-e87b16108e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d448902-5c9c-4884-8e51-e87b16108e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cdd4694-57df-4f36-b14c-24224335395a', 'volume_name': 'volume-6cdd4694-57df-4f36-b14c-24224335395a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6dba06a-9766-430f-a99c-817d2d8aaff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6dba06a-9766-430f-a99c-817d2d8aaff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4226131f-5cc8-4f5c-850a-59679c1ed1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:16 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume 6cdd4694-57df-4f36-b14c-24224335395a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cdd4694-57df-4f36-b14c-24224335395a', 'volume_size': 1}
Sep 10 14:14:16 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:16 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:16 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:14:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Flow 'volume_create_manager' (8787a977-8eb7-4b87-abe7-c639cccc449a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:16 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d0d40d-31ed-4260-8ce5-db77fb2e434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d395073-4971-4097-ad54-ca6f4cba6c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '62e190e6-ac33-477e-b774-52d34591155c', 'volume_name': 'volume-62e190e6-ac33-477e-b774-52d34591155c', 'volume_size': 1, 'image_id': '80a33176-1346-481d-a54a-227d0d284790', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f335ee2cf5dbb125d837a099dc4df3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b2beb185995b49f1bcfbc0c309d6b226', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a3c03e4cee4042a6f3c52d758f205de0293b5e454c92aaa6e21550bd422a76eb51a793e24e66a11107f880541bd42725e3629b913e33cf08fcd8cd6f30c194f', 'id': '80a33176-1346-481d-a54a-227d0d284790', 'created_at': datetime.datetime(2025, 9, 10, 12, 14, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 12, 14, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80a33176-1346-481d-a54a-227d0d284790/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b555a170>}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3b1a54-e5b5-4e81-9934-dda38403933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3b1a54-e5b5-4e81-9934-dda38403933a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b9409a2-1bd8-4d07-844a-bbb7d7ff75bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:17 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Volume 62e190e6-ac33-477e-b774-52d34591155c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-62e190e6-ac33-477e-b774-52d34591155c', 'volume_size': 1, 'image_id': '80a33176-1346-481d-a54a-227d0d284790', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f335ee2cf5dbb125d837a099dc4df3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b2beb185995b49f1bcfbc0c309d6b226', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a3c03e4cee4042a6f3c52d758f205de0293b5e454c92aaa6e21550bd422a76eb51a793e24e66a11107f880541bd42725e3629b913e33cf08fcd8cd6f30c194f', 'id': '80a33176-1346-481d-a54a-227d0d284790', 'created_at': datetime.datetime(2025, 9, 10, 12, 14, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 12, 14, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80a33176-1346-481d-a54a-227d0d284790/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b555a170>}
Sep 10 14:14:17 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Cloning 62e190e6-ac33-477e-b774-52d34591155c from image 80a33176-1346-481d-a54a-227d0d284790  at location (None, None). {{(pid=82823) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 14:14:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d0d40d-31ed-4260-8ce5-db77fb2e434d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-808464265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d2697c-d43c-488c-bcf7-ecafeeed06b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94507ada92747d7b4af368743a09590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:16Z,use_quota=True,user_id='7c44448e430f47dfa723440f0e5c0e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a97572-3c23-4ce6-b0aa-c36ba00b81af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a97572-3c23-4ce6-b0aa-c36ba00b81af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9834f570-ee64-4add-83f7-8b846013680f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9834f570-ee64-4add-83f7-8b846013680f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86d2697c-d43c-488c-bcf7-ecafeeed06b0', 'volume_name': 'volume-86d2697c-d43c-488c-bcf7-ecafeeed06b0', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a86e1a-6688-437d-a3df-54b939545e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a86e1a-6688-437d-a3df-54b939545e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:17 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be65c98e-063d-49d0-899a-402f55343ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:17 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume 86d2697c-d43c-488c-bcf7-ecafeeed06b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86d2697c-d43c-488c-bcf7-ecafeeed06b0', 'volume_size': 1}
Sep 10 14:14:17 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:17 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 14:14:17 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Image download 0.00 MB at 0.00 MB/s
Sep 10 14:14:18 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4208199-72b2-4ddc-8975-ec89d290d900]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:18 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=73,cinder:UPDATE=103,cinder:DELETE=21,cinder:INSERT=24 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:14:18 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2d8a8584-0dbd-4212-a11e-50b470bd951f" returned: 0 in 7.276s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[427cf18a-0364-497e-990b-b665ff7e7908]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=137,cinder:SELECT=85,cinder:DELETE=5,cinder:INSERT=20 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:19 devstack sudo[99889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD
Sep 10 14:14:19 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 14:14:19 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Flow 'volume_create_manager' (d27513b0-fa6b-404d-a3a5-37f8aee98194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9814774a-c2dd-4e88-951e-78942cf80cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9814774a-c2dd-4e88-951e-78942cf80cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1054327444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77c5655-a6c3-43f0-a955-c59496f70b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94507ada92747d7b4af368743a09590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:18Z,use_quota=True,user_id='7c44448e430f47dfa723440f0e5c0e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e9ff52-e09a-4e90-91a6-94ffd03342a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e9ff52-e09a-4e90-91a6-94ffd03342a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29885158-4d98-4166-8f47-fece9e8884cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29885158-4d98-4166-8f47-fece9e8884cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a77c5655-a6c3-43f0-a955-c59496f70b45', 'volume_name': 'volume-a77c5655-a6c3-43f0-a955-c59496f70b45', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9892594-fa57-4c4b-b4aa-3b249c053d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9892594-fa57-4c4b-b4aa-3b249c053d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78325620-b023-422c-a49d-61a4721628e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:19 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume a77c5655-a6c3-43f0-a955-c59496f70b45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a77c5655-a6c3-43f0-a955-c59496f70b45', 'volume_size': 1}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821" returned: 0 in 0.924s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Image conversion details: src /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821, size 1024.00 MB, duration 7.28 sec, destination /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2d8a8584-0dbd-4212-a11e-50b470bd951f {{(pid=82823) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 14:14:19 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Converted 1024.00 MB image at 140.59 MB/s
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2d8a8584-0dbd-4212-a11e-50b470bd951f is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:14:19 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2d8a8584-0dbd-4212-a11e-50b470bd951f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2d8a8584-0dbd-4212-a11e-50b470bd951f" returned: 0 in 0.136s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-quobyte-2d8a8584-0dbd-4212-a11e-50b470bd951f" released by "_copy_volume_from_snapshot" :: held 9.766s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:20 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-quobyte-c486e304-dc2d-4957-95fa-974d9c7110e1-2d8a8584-0dbd-4212-a11e-50b470bd951f" released by "_create_volume_from_snapshot" :: held 9.815s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.930s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1476499194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329de748-a52e-4437-a281-a04ad573493c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94507ada92747d7b4af368743a09590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:12Z,use_quota=True,user_id='7c44448e430f47dfa723440f0e5c0e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:14:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Creating volume 329de748-a52e-4437-a281-a04ad573493c {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:14:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:20 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:14:20 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:14:20 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-329de748-a52e-4437-a281-a04ad573493c 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:20 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=164, name=volume-329de748-a52e-4437-a281-a04ad573493c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76292f8a-18d2-4abf-b379-258c7e3b438a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8a8584-0dbd-4212-a11e-50b470bd951f', 'volume_size': 1, 'snapshot_id': 'c486e304-dc2d-4957-95fa-974d9c7110e1'}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e16ec9f-2b64-4750-9f75-1f5a31fa8f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-329de748-a52e-4437-a281-a04ad573493c 1073741824" returned: 0 in 0.719s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-329de748-a52e-4437-a281-a04ad573493c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:21 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Volume volume-2d8a8584-0dbd-4212-a11e-50b470bd951f (2d8a8584-0dbd-4212-a11e-50b470bd951f): created successfully
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e16ec9f-2b64-4750-9f75-1f5a31fa8f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Flow 'volume_create_manager' (53c7f6e6-36d5-4bfd-a0b0-33292922db00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-329de748-a52e-4437-a281-a04ad573493c" returned: 0 in 0.468s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] <== create_volume: return (1241ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:21 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.125s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-874495663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddac40f2-d5ef-462d-80a8-1b39acfab372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94507ada92747d7b4af368743a09590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:13Z,use_quota=True,user_id='7c44448e430f47dfa723440f0e5c0e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Creating volume ddac40f2-d5ef-462d-80a8-1b39acfab372 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:14:21 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:14:21 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ddac40f2-d5ef-462d-80a8-1b39acfab372 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:21 devstack quobyte-client[82845]: System call of process 99903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:21 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=165, name=volume-ddac40f2-d5ef-462d-80a8-1b39acfab372, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:14:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD" returned: 0 in 3.969s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104b2ea6-c784-4bdf-bf72-7289e85091f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-329de748-a52e-4437-a281-a04ad573493c', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00355e5e-0c4e-4f64-8a26-43b41ebb4ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:22 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "cinder-c486e304-dc2d-4957-95fa-974d9c7110e1-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:22 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-3aaa0b14-05b7-4f6b-b636-c75d6d9ee6f7 tempest-SnapshotDependencyTests-1545310328 None] Created volume successfully.
Sep 10 14:14:22 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume volume-329de748-a52e-4437-a281-a04ad573493c (329de748-a52e-4437-a281-a04ad573493c): created successfully
Sep 10 14:14:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00355e5e-0c4e-4f64-8a26-43b41ebb4ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:22 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Flow 'volume_create_manager' (710b4e72-6bad-4d72-972e-a02501543be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ddac40f2-d5ef-462d-80a8-1b39acfab372 1073741824" returned: 0 in 1.054s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:22 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ddac40f2-d5ef-462d-80a8-1b39acfab372 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:22 devstack sudo[99906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD
Sep 10 14:14:22 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-c486e304-dc2d-4957-95fa-974d9c7110e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.456s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:23 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "cinder-quobyte-af6ee4fa-411d-431f-8035-453b1f259821" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:23 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-d525a55f-fc6d-443c-b646-ad53a5159fcf tempest-CreateVolumesFromSnapshotTest-266245230 None] Created volume successfully.
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ddac40f2-d5ef-462d-80a8-1b39acfab372" returned: 0 in 0.396s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] <== create_volume: return (1491ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.533s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1173318220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cdd4694-57df-4f36-b14c-24224335395a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94507ada92747d7b4af368743a09590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:15Z,use_quota=True,user_id='7c44448e430f47dfa723440f0e5c0e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Creating volume 6cdd4694-57df-4f36-b14c-24224335395a {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:14:23 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6cdd4694-57df-4f36-b14c-24224335395a 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:23 devstack quobyte-client[82845]: System call of process 99909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:23 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=166, name=volume-6cdd4694-57df-4f36-b14c-24224335395a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa12cafe-b938-4d9a-99c4-b5461381a2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddac40f2-d5ef-462d-80a8-1b39acfab372', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afac8826-bdfc-4b13-8810-fede500c1274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-quobyte-af6ee4fa-411d-431f-8035-453b1f259821" acquired by "delete_snapshot" :: waited 0.750s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "cinder-quobyte-c486e304-dc2d-4957-95fa-974d9c7110e1" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6cdd4694-57df-4f36-b14c-24224335395a 1073741824" returned: 0 in 0.558s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:23 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6cdd4694-57df-4f36-b14c-24224335395a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:24 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume volume-ddac40f2-d5ef-462d-80a8-1b39acfab372 (ddac40f2-d5ef-462d-80a8-1b39acfab372): created successfully
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afac8826-bdfc-4b13-8810-fede500c1274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Flow 'volume_create_manager' (2bfeecad-9aec-424a-99ed-f1b3f184add6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-quobyte-c486e304-dc2d-4957-95fa-974d9c7110e1" acquired by "_delete_snapshot" :: waited 0.442s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Deleting offline snapshot c486e304-dc2d-4957-95fa-974d9c7110e1 of volume af6ee4fa-411d-431f-8035-453b1f259821 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] snapshot_file for this snap is: volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7dd14b-99a8-4756-8c78-5fc2d1b419b8]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:24 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-70fca23a-ed69-46ee-bdab-ce1d550db51a tempest-CreateVolumesFromSnapshotTest-266245230 None] Created volume successfully.
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6cdd4694-57df-4f36-b14c-24224335395a" returned: 0 in 0.553s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] <== create_volume: return (1216ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.169s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-808464265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d2697c-d43c-488c-bcf7-ecafeeed06b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94507ada92747d7b4af368743a09590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:16Z,use_quota=True,user_id='7c44448e430f47dfa723440f0e5c0e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Creating volume 86d2697c-d43c-488c-bcf7-ecafeeed06b0 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:14:24 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:14:24 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-86d2697c-d43c-488c-bcf7-ecafeeed06b0 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:25 devstack quobyte-client[82845]: System call of process 99918 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:25 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=167, name=volume-86d2697c-d43c-488c-bcf7-ecafeeed06b0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:14:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4226131f-5cc8-4f5c-850a-59679c1ed1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cdd4694-57df-4f36-b14c-24224335395a', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de16ae3-79e9-4b53-8881-fd4e5e38cdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:25 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root
Sep 10 14:14:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD" returned: 1 in 3.342s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:14:25 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Temporary image 80a33176-1346-481d-a54a-227d0d284790 is fetched for user 1e60dcf8012a45049013519ecd0e5680. {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 14:14:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1" returned: 0 in 1.349s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:25 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af6ee4fa-411d-431f-8035-453b1f259821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:14:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-86d2697c-d43c-488c-bcf7-ecafeeed06b0 1073741824" returned: 0 in 0.909s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:25 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-86d2697c-d43c-488c-bcf7-ecafeeed06b0 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:25 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume volume-6cdd4694-57df-4f36-b14c-24224335395a (6cdd4694-57df-4f36-b14c-24224335395a): created successfully
Sep 10 14:14:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de16ae3-79e9-4b53-8881-fd4e5e38cdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:25 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Flow 'volume_create_manager' (2fad34e4-8d44-4352-9838-d9920df9ee5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:26 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[061d9136-d0c6-4bc1-9ce2-6e0aa7f7a0cd]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:26 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b65abd52-17ae-41be-8bb4-66db1046f317 tempest-CreateVolumesFromSnapshotTest-266245230 None] Created volume successfully.
Sep 10 14:14:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-86d2697c-d43c-488c-bcf7-ecafeeed06b0" returned: 0 in 0.720s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:26 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] <== create_volume: return (1697ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:14:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.830s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:26 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1054327444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77c5655-a6c3-43f0-a955-c59496f70b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94507ada92747d7b4af368743a09590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:18Z,use_quota=True,user_id='7c44448e430f47dfa723440f0e5c0e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:14:26 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Creating volume a77c5655-a6c3-43f0-a955-c59496f70b45 {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:14:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:26 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:26 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:26 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:14:26 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:14:26 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a77c5655-a6c3-43f0-a955-c59496f70b45 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:26 devstack quobyte-client[82845]: System call of process 99924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:26 devstack quobyte-client[82845]: System call of process 99925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:26 devstack quobyte-client[82845]: System call of process 99925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:26 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=168, name=volume-a77c5655-a6c3-43f0-a955-c59496f70b45, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:14:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be65c98e-063d-49d0-899a-402f55343ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86d2697c-d43c-488c-bcf7-ecafeeed06b0', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a00bb23-a85f-4db4-a33f-0ae453cb4b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821" returned: 0 in 0.948s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a77c5655-a6c3-43f0-a955-c59496f70b45 1073741824" returned: 0 in 0.590s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:27 devstack quobyte-client[82845]: System call of process 99930 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:27 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume volume-86d2697c-d43c-488c-bcf7-ecafeeed06b0 (86d2697c-d43c-488c-bcf7-ecafeeed06b0): created successfully
Sep 10 14:14:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a00bb23-a85f-4db4-a33f-0ae453cb4b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:27 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Flow 'volume_create_manager' (8787a977-8eb7-4b87-abe7-c639cccc449a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a77c5655-a6c3-43f0-a955-c59496f70b45 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:27 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[159d324e-b139-431c-ad1d-ab71a4d1ac81]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:27 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-61da0969-f664-4a98-b174-84c173952955 tempest-CreateVolumesFromSnapshotTest-266245230 None] Created volume successfully.
Sep 10 14:14:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a77c5655-a6c3-43f0-a955-c59496f70b45" returned: 0 in 0.482s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:27 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] <== create_volume: return (1317ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:14:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1" returned: 0 in 0.847s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:27 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:28 devstack sudo[99934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD
Sep 10 14:14:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78325620-b023-422c-a49d-61a4721628e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a77c5655-a6c3-43f0-a955-c59496f70b45', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:28 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 14:14:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df1bbd2-d4c0-4f59-8ab2-c973a8eb7d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:28 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821.c486e304-dc2d-4957-95fa-974d9c7110e1" returned: 0 in 0.343s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:28 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume volume-a77c5655-a6c3-43f0-a955-c59496f70b45 (a77c5655-a6c3-43f0-a955-c59496f70b45): created successfully
Sep 10 14:14:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df1bbd2-d4c0-4f59-8ab2-c973a8eb7d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:28 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Flow 'volume_create_manager' (d27513b0-fa6b-404d-a3a5-37f8aee98194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-quobyte-c486e304-dc2d-4957-95fa-974d9c7110e1" released by "_delete_snapshot" :: held 4.061s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:28 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-358abc1d-bf3a-4346-abb2-b80107abb25a tempest-CreateVolumesFromSnapshotTest-266245230 None] Created volume successfully.
Sep 10 14:14:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-quobyte-af6ee4fa-411d-431f-8035-453b1f259821" released by "delete_snapshot" :: held 4.542s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:28 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Created reservations ['7b711380-aa29-4ea3-88a5-80a73e0698b0', '31f03410-859c-4f76-a5f2-91631a5bf04b', 'bb55b6f8-9958-4d18-8f44-2f3baa0dde7b', '7b60f5ec-d281-4df1-961e-d53725b1e3e9'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:14:28 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Delete snapshot completed successfully.
Sep 10 14:14:28 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-61d65f5e-8299-4afa-b87c-c72cec0d26a9 tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-c486e304-dc2d-4957-95fa-974d9c7110e1-delete_snapshot" released by "delete_snapshot" :: held 5.919s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "cinder-a77c5655-a6c3-43f0-a955-c59496f70b45-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-a77c5655-a6c3-43f0-a955-c59496f70b45-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:29 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "cinder-quobyte-a77c5655-a6c3-43f0-a955-c59496f70b45" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:29 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-a77c5655-a6c3-43f0-a955-c59496f70b45" acquired by "delete_volume" :: waited 0.015s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:29 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f6d490-4330-45ae-9d34-01930aa7da9a]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a77c5655-a6c3-43f0-a955-c59496f70b45 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:29 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a77c5655-a6c3-43f0-a955-c59496f70b45" returned: 0 in 0.694s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a77c5655-a6c3-43f0-a955-c59496f70b45 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:30 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 14:14:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "cinder-af6ee4fa-411d-431f-8035-453b1f259821-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-a77c5655-a6c3-43f0-a955-c59496f70b45" returned: 0 in 0.829s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:30 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root
Sep 10 14:14:30 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-af6ee4fa-411d-431f-8035-453b1f259821-delete_volume" acquired by "delete_volume" :: waited 0.223s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.510s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:31 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:14:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-a77c5655-a6c3-43f0-a955-c59496f70b45" released by "delete_volume" :: held 1.853s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD" returned: 0 in 3.518s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:31 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "cinder-quobyte-af6ee4fa-411d-431f-8035-453b1f259821" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:31 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-quobyte-af6ee4fa-411d-431f-8035-453b1f259821" acquired by "delete_volume" :: waited 0.074s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:31 devstack sudo[99982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD
Sep 10 14:14:31 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 14:14:31 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6d9349-b971-432a-bca7-1ec8e522cc47]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:31 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:32 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Created reservations ['1636d559-0eb9-4363-b564-8ed1ae209b2a', 'aeef2a8c-5b5f-4bfb-8fcf-4594cdc02445', '40ffc49e-0a8e-46e6-89a1-39987aef4198', 'b0d09a89-3069-4956-8b73-ad021da8c6a1'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:14:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821" returned: 0 in 0.620s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "cinder-86d2697c-d43c-488c-bcf7-ecafeeed06b0-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-af6ee4fa-411d-431f-8035-453b1f259821" returned: 0 in 0.501s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-86d2697c-d43c-488c-bcf7-ecafeeed06b0-delete_volume" acquired by "delete_volume" :: waited 0.147s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:32 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-quobyte-af6ee4fa-411d-431f-8035-453b1f259821" released by "delete_volume" :: held 1.324s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:32 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:33 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "cinder-quobyte-86d2697c-d43c-488c-bcf7-ecafeeed06b0" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.799s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:14:33 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root
Sep 10 14:14:33 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Deleted volume successfully.
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD" returned: 1 in 2.844s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e190e6-ac33-477e-b774-52d34591155c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2beb185995b49f1bcfbc0c309d6b226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:12Z,use_quota=True,user_id='1e60dcf8012a45049013519ecd0e5680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Creating volume 62e190e6-ac33-477e-b774-52d34591155c {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:14:33 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:14:33 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:34 devstack quobyte-client[82845]: System call of process 99993 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-86d2697c-d43c-488c-bcf7-ecafeeed06b0" acquired by "delete_volume" :: waited 0.335s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:34 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=169, name=volume-62e190e6-ac33-477e-b774-52d34591155c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:14:34 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1c86be-e69b-4c3f-9973-da4aee2dc10d]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-86d2697c-d43c-488c-bcf7-ecafeeed06b0 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:34 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-0e84a783-13d0-4105-b7e0-05cfea5c36ac tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-a77c5655-a6c3-43f0-a955-c59496f70b45-delete_volume" released by "delete_volume" :: held 5.641s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c 1073741824" returned: 0 in 0.757s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:34 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:34 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Created reservations ['b9fe6704-de4a-44dc-a995-a795946fb6d5', '15ab995d-55df-4713-a2be-24bbde6cb480', '73ea9155-510e-4734-8f79-0e42df6bf93d', '7417efc1-d612-457c-a0d9-f90c389affb9'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c" returned: 0 in 0.354s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] <== create_volume: return (1130ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-86d2697c-d43c-488c-bcf7-ecafeeed06b0" returned: 0 in 0.816s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-86d2697c-d43c-488c-bcf7-ecafeeed06b0 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-86d2697c-d43c-488c-bcf7-ecafeeed06b0" returned: 0 in 0.294s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Attempting download of 80a33176-1346-481d-a54a-227d0d284790 ((None, None)) to volume 62e190e6-ac33-477e-b774-52d34591155c. {{(pid=82823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-86d2697c-d43c-488c-bcf7-ecafeeed06b0" released by "delete_volume" :: held 1.484s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8c426f-23a3-41e3-8d1a-593ca19ad9fb]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80a33176-1346-481d-a54a-227d0d284790_fu098dnz {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:35 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:36 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "cinder-2d8a8584-0dbd-4212-a11e-50b470bd951f-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80a33176-1346-481d-a54a-227d0d284790_fu098dnz" returned: 0 in 0.694s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.516s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:36 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80a33176-1346-481d-a54a-227d0d284790_fu098dnz {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:36 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:14:36 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-2d8a8584-0dbd-4212-a11e-50b470bd951f-delete_volume" acquired by "delete_volume" :: waited 0.379s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:36 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Deleted volume successfully.
Sep 10 14:14:36 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Created reservations ['a3869ff1-efd6-43cd-8624-cbdb0a95331f', 'feb87afa-8d72-4002-9b7f-e981d862fceb', 'be78bede-565c-4e5f-8c73-e4e4ae7a3b50', '544f3a1e-7617-4707-9eb5-96bfc5dd3d1a'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80a33176-1346-481d-a54a-227d0d284790_fu098dnz" returned: 1 in 0.608s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80a33176-1346-481d-a54a-227d0d284790_fu098dnz' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-d17aefae-7467-40e6-b8bb-da0e215bf43e tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-af6ee4fa-411d-431f-8035-453b1f259821-delete_volume" released by "delete_volume" :: held 6.145s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a60084-4dd2-4310-8555-98af9aac8efd]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "cinder-6cdd4694-57df-4f36-b14c-24224335395a-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:37 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "cinder-quobyte-2d8a8584-0dbd-4212-a11e-50b470bd951f" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-6cdd4694-57df-4f36-b14c-24224335395a-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-quobyte-2d8a8584-0dbd-4212-a11e-50b470bd951f" acquired by "delete_volume" :: waited 0.051s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ab626f-f81d-4a58-8552-a82a052c5b88]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:37 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2d8a8584-0dbd-4212-a11e-50b470bd951f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD" returned: 0 in 0.954s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:38 devstack quobyte-client[82845]: System call of process 100009 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:38 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:38 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "cinder-quobyte-6cdd4694-57df-4f36-b14c-24224335395a" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.980s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:38 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:14:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2d8a8584-0dbd-4212-a11e-50b470bd951f" returned: 0 in 0.796s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:38 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2d8a8584-0dbd-4212-a11e-50b470bd951f {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:38 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Deleted volume successfully.
Sep 10 14:14:39 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-6cdd4694-57df-4f36-b14c-24224335395a" acquired by "delete_volume" :: waited 0.432s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:39 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fea72ab-e848-4184-9fd4-33f7b811232d]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6cdd4694-57df-4f36-b14c-24224335395a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD" returned: 1 in 1.139s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:14:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-2d8a8584-0dbd-4212-a11e-50b470bd951f" returned: 0 in 0.583s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:39 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] 80a33176-1346-481d-a54a-227d0d284790 was raw, converting to raw {{(pid=82823) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 14:14:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:39 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=169, name=volume-62e190e6-ac33-477e-b774-52d34591155c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:14:39 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-25748464-83e4-4838-8fff-7ac6d6f46d1d tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-86d2697c-d43c-488c-bcf7-ecafeeed06b0-delete_volume" released by "delete_volume" :: held 6.701s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c" returned: 0 in 0.335s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:39 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_80a33176-1346-481d-a54a-227d0d284790__1pncjc0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c {{(pid=82823) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 14:14:39 devstack cinder-volume[82823]: INFO cinder.image.image_utils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Converted 0.00 MB image at 0.00 MB/s
Sep 10 14:14:39 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:39 devstack quobyte-client[82845]: System call of process 100022 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:39 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-quobyte-2d8a8584-0dbd-4212-a11e-50b470bd951f" released by "delete_volume" :: held 2.181s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6cdd4694-57df-4f36-b14c-24224335395a" returned: 0 in 0.930s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6cdd4694-57df-4f36-b14c-24224335395a {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c 1G" returned: 0 in 0.622s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-6cdd4694-57df-4f36-b14c-24224335395a" returned: 0 in 0.298s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:40 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-6cdd4694-57df-4f36-b14c-24224335395a" released by "delete_volume" :: held 1.363s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:40 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab7b91a-cb5e-4aa4-bcc4-5b55f2d71c79]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:40 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:40 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Created reservations ['1e916deb-cbc3-4d5d-8739-c89996f411ab', 'b138c50a-28a6-450b-b7da-cc24b2b857ac', '607bdb60-849a-4fb1-8894-e1f17dcbe83e', '21489ea2-2a28-48ac-9186-5d5852c2e1c4'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Created reservations ['856f9009-084a-4cdc-8b0a-2c7ed3be3f7e', '2716e8a6-e2f9-4941-849b-418c637d8f0a', '4a23979b-f0f1-41ea-8ce6-bd2e1e8a8528', 'f2d1f0c6-c7ca-4b90-87db-f252e8684283'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c" returned: 0 in 0.604s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c" returned: 1 in 0.684s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.291s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Downloaded image 80a33176-1346-481d-a54a-227d0d284790 ((None, None)) to volume 62e190e6-ac33-477e-b774-52d34591155c successfully. {{(pid=82823) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG cinder.image.image_utils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Temporary image 80a33176-1346-481d-a54a-227d0d284790 for user 1e60dcf8012a45049013519ecd0e5680 is deleted. {{(pid=82823) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG cinder.volume.volume_utils [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Marking volume 62e190e6-ac33-477e-b774-52d34591155c as bootable. {{(pid=82823) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 14:14:41 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:14:42 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Deleted volume successfully.
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Copying metadata from image 80a33176-1346-481d-a54a-227d0d284790 to 62e190e6-ac33-477e-b774-52d34591155c. {{(pid=82823) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Creating volume glance metadata for volume 62e190e6-ac33-477e-b774-52d34591155c backed by image 80a33176-1346-481d-a54a-227d0d284790 with: {'image_id': '80a33176-1346-481d-a54a-227d0d284790', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3f335ee2cf5dbb125d837a099dc4df3f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82823) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "cinder-ddac40f2-d5ef-462d-80a8-1b39acfab372-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-4e99ecfd-eee2-4096-8d38-5da703d56b09 tempest-SnapshotDependencyTests-1545310328 None] Lock "cinder-2d8a8584-0dbd-4212-a11e-50b470bd951f-delete_volume" released by "delete_volume" :: held 5.914s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-ddac40f2-d5ef-462d-80a8-1b39acfab372-delete_volume" acquired by "delete_volume" :: waited 0.457s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.434s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:14:42 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Deleted volume successfully.
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b9409a2-1bd8-4d07-844a-bbb7d7ff75bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62e190e6-ac33-477e-b774-52d34591155c', 'volume_size': 1, 'image_id': '80a33176-1346-481d-a54a-227d0d284790', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f335ee2cf5dbb125d837a099dc4df3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b2beb185995b49f1bcfbc0c309d6b226', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a3c03e4cee4042a6f3c52d758f205de0293b5e454c92aaa6e21550bd422a76eb51a793e24e66a11107f880541bd42725e3629b913e33cf08fcd8cd6f30c194f', 'id': '80a33176-1346-481d-a54a-227d0d284790', 'created_at': datetime.datetime(2025, 9, 10, 12, 14, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 12, 14, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80a33176-1346-481d-a54a-227d0d284790/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f95b555a170>}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a528297d-de10-48f2-aa34-55d2c9760005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7190debc-9b64-4fc4-ace3-cb69adcdda83 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-6cdd4694-57df-4f36-b14c-24224335395a-delete_volume" released by "delete_volume" :: held 5.314s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:42 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Volume volume-62e190e6-ac33-477e-b774-52d34591155c (62e190e6-ac33-477e-b774-52d34591155c): created successfully
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a528297d-de10-48f2-aa34-55d2c9760005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:42 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Flow 'volume_create_manager' (53163a11-37fd-4f91-b324-666b9a9ee164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:43 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:43 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "cinder-quobyte-ddac40f2-d5ef-462d-80a8-1b39acfab372" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:43 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-ddac40f2-d5ef-462d-80a8-1b39acfab372" acquired by "delete_volume" :: waited 0.018s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:43 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-e0ff85a6-18ec-4eec-968c-d64a09d232c0 tempest-VolumeImageDependencyTests-1163215430 None] Created volume successfully.
Sep 10 14:14:43 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fa2639-3cbe-4f45-aa89-63be2dcec621]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ddac40f2-d5ef-462d-80a8-1b39acfab372 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:43 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Acquiring lock "cinder-62e190e6-ac33-477e-b774-52d34591155c-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ddac40f2-d5ef-462d-80a8-1b39acfab372" returned: 0 in 0.766s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:43 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Lock "cinder-62e190e6-ac33-477e-b774-52d34591155c-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:43 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ddac40f2-d5ef-462d-80a8-1b39acfab372 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ddac40f2-d5ef-462d-80a8-1b39acfab372" returned: 0 in 0.326s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:44 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-ddac40f2-d5ef-462d-80a8-1b39acfab372" released by "delete_volume" :: held 1.366s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:44 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:44 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Acquiring lock "cinder-quobyte-62e190e6-ac33-477e-b774-52d34591155c" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:44 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Lock "cinder-quobyte-62e190e6-ac33-477e-b774-52d34591155c" acquired by "delete_volume" :: waited 0.049s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:44 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[e674b5b9-80fa-465c-a601-4694358f3bd3]: (4, 'raw') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:44 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:45 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Created reservations ['b9241c34-ea0d-4714-a56f-04f99af17d7f', 'b9dabb7f-865a-4e24-88fc-e9a8dc8ccd14', '8ffb1176-04b5-4875-96a4-695fb5401083', 'ed8806f0-427a-4e92-98c2-9cec3e2053d2'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:14:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c" returned: 0 in 0.850s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.041s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:45 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:45 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:46 devstack quobyte-client[82845]: System call of process 100043 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "cinder-329de748-a52e-4437-a281-a04ad573493c-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.420s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:46 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:14:46 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Deleted volume successfully.
Sep 10 14:14:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-329de748-a52e-4437-a281-a04ad573493c-delete_volume" acquired by "delete_volume" :: waited 0.240s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c" returned: 1 in 0.939s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c' failed. Not Retrying. {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 14:14:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a8569249-bd7a-4aed-b956-f87bf5fb0ec5 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-ddac40f2-d5ef-462d-80a8-1b39acfab372-delete_volume" released by "delete_volume" :: held 4.174s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:46 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-62e190e6-ac33-477e-b774-52d34591155c" returned: 0 in 0.491s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:46 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Lock "cinder-quobyte-62e190e6-ac33-477e-b774-52d34591155c" released by "delete_volume" :: held 2.487s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:47 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "cinder-quobyte-329de748-a52e-4437-a281-a04ad573493c" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:47 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-329de748-a52e-4437-a281-a04ad573493c" acquired by "delete_volume" :: waited 0.046s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:47 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[8138b382-3f1f-4c2f-ae03-19d290071df4]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-329de748-a52e-4437-a281-a04ad573493c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:47 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Created reservations ['4ed1a58b-6acc-4c81-9fd1-6a33e6643e37', '6c7d132b-6f19-45c5-b22f-7033abefbd79', '5933ee86-5f25-49c3-a2f3-78f999ec93fe', '6987d939-7f2d-45d2-9bdc-4ab0bc1b9f97'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:14:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:47 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:47 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-329de748-a52e-4437-a281-a04ad573493c" returned: 0 in 0.889s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-329de748-a52e-4437-a281-a04ad573493c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.331s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:48 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:14:48 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Deleted volume successfully.
Sep 10 14:14:48 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-329de748-a52e-4437-a281-a04ad573493c" returned: 0 in 0.465s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:48 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-329de748-a52e-4437-a281-a04ad573493c" released by "delete_volume" :: held 1.529s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:48 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-7c9f18ac-06d1-4a0c-9d1e-f8e62981fea4 tempest-VolumeImageDependencyTests-1163215430 None] Lock "cinder-62e190e6-ac33-477e-b774-52d34591155c-delete_volume" released by "delete_volume" :: held 4.927s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:48 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Created reservations ['79f42708-a09c-4dac-89cd-1263c842e13a', 'e630434a-a7f7-4439-9295-88a0f033ad98', '61055efc-d228-4490-b378-3942164f9864', '6273cc08-9ed7-4215-8428-9a866ca600a1'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:14:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:49 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:49 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "cinder-b6142b1e-94da-48bc-be06-4849c8be5932-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-b6142b1e-94da-48bc-be06-4849c8be5932-delete_snapshot" acquired by "delete_snapshot" :: waited 0.192s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:49 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:49 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "cinder-quobyte-55013a94-5728-42f1-b88d-19059c096437" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:49 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.566s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:49 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:14:49 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Deleted volume successfully.
Sep 10 14:14:50 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-55013a94-5728-42f1-b88d-19059c096437" acquired by "delete_snapshot" :: waited 0.311s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:50 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "cinder-quobyte-b6142b1e-94da-48bc-be06-4849c8be5932" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:50 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-b6142b1e-94da-48bc-be06-4849c8be5932" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Deleting offline snapshot b6142b1e-94da-48bc-be06-4849c8be5932 of volume 55013a94-5728-42f1-b88d-19059c096437 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:14:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] snapshot_file for this snap is: volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:14:50 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-b1d8cdf7-674b-43b6-8f58-4fb327776396 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-329de748-a52e-4437-a281-a04ad573493c-delete_volume" released by "delete_volume" :: held 3.839s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:50 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0076f2-3cf7-4733-ab6e-97492e84ec97]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:50 devstack quobyte-client[82845]: System call of process 100055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:50 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932" returned: 0 in 0.609s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:50 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55013a94-5728-42f1-b88d-19059c096437(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:14:51 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[98aa55f8-91fb-4a65-a33c-4b2144867e31]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437" returned: 0 in 0.593s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:51 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932" returned: 0 in 0.378s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:52 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437.b6142b1e-94da-48bc-be06-4849c8be5932" returned: 0 in 0.248s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-b6142b1e-94da-48bc-be06-4849c8be5932" released by "_delete_snapshot" :: held 2.338s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:52 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-55013a94-5728-42f1-b88d-19059c096437" released by "delete_snapshot" :: held 2.382s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:52 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Created reservations ['c29888a4-f76e-450e-9ede-41a49c8f43ed', '589cdf11-e01a-4dc2-b5f9-ce09262cfe63', 'aac7a36b-6daf-49e5-9ef6-1e562c0a1ccc', '8048b2c9-a04c-4073-ad1d-730c17edfee3'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:14:53 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Delete snapshot completed successfully.
Sep 10 14:14:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e071a544-3220-40a5-b1fa-72c9e39a59e1 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-b6142b1e-94da-48bc-be06-4849c8be5932-delete_snapshot" released by "delete_snapshot" :: held 3.268s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "cinder-55013a94-5728-42f1-b88d-19059c096437-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:53 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-55013a94-5728-42f1-b88d-19059c096437-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:54 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "cinder-quobyte-55013a94-5728-42f1-b88d-19059c096437" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:14:54 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-55013a94-5728-42f1-b88d-19059c096437" acquired by "delete_volume" :: waited 0.015s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:14:54 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[f114dc9f-6638-4e20-a01e-ebf1f428ae20]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:14:54 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:54 devstack quobyte-client[82845]: System call of process 100067 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437" returned: 0 in 0.825s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:55 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Flow 'volume_create_manager' (61035db2-71df-4547-89cc-8d3d3141e228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81e7b33-bad8-4c5f-a6d0-1124175fa999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81e7b33-bad8-4c5f-a6d0-1124175fa999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4b758d-fceb-4536-8010-4b4376e8f6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16865881ab14ed2a7fea9221924adc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:55Z,use_quota=True,user_id='8020203a1ba1427f90c34c3701eff1bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5b5707-2b9c-4f06-939d-c675786bf9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5b5707-2b9c-4f06-939d-c675786bf9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e2d257-3481-46b8-9957-d6f294d47ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e2d257-3481-46b8-9957-d6f294d47ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea4b758d-fceb-4536-8010-4b4376e8f6ce', 'volume_name': 'volume-ea4b758d-fceb-4536-8010-4b4376e8f6ce', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a737b3-52ca-4577-b1ff-4405dc695128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a737b3-52ca-4577-b1ff-4405dc695128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d79c62-3803-4d21-acb0-bc03dfda0768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:55 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Volume ea4b758d-fceb-4536-8010-4b4376e8f6ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea4b758d-fceb-4536-8010-4b4376e8f6ce', 'volume_size': 1}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4b758d-fceb-4536-8010-4b4376e8f6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16865881ab14ed2a7fea9221924adc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:55Z,use_quota=True,user_id='8020203a1ba1427f90c34c3701eff1bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Creating volume ea4b758d-fceb-4536-8010-4b4376e8f6ce {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:14:55 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ea4b758d-fceb-4536-8010-4b4376e8f6ce 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:55 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-55013a94-5728-42f1-b88d-19059c096437" returned: 0 in 0.786s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:55 devstack quobyte-client[82845]: System call of process 100071 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:55 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=170, name=volume-ea4b758d-fceb-4536-8010-4b4376e8f6ce, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:14:56 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-quobyte-55013a94-5728-42f1-b88d-19059c096437" released by "delete_volume" :: held 1.801s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ea4b758d-fceb-4536-8010-4b4376e8f6ce 1073741824" returned: 0 in 0.624s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ea4b758d-fceb-4536-8010-4b4376e8f6ce {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ea4b758d-fceb-4536-8010-4b4376e8f6ce" returned: 0 in 0.428s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:56 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] <== create_volume: return (1122ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:14:56 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:57 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Created reservations ['6fb94028-d2d8-497b-adbe-27e9165df69a', '8ee85381-9eaf-462b-9595-d60fe166d858', '201a0ac6-7001-446e-89d9-8132438d796c', 'ca7197f2-e99f-4355-b2d6-837c16c1eca2'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:14:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d79c62-3803-4d21-acb0-bc03dfda0768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea4b758d-fceb-4536-8010-4b4376e8f6ce', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c89503-5799-4792-9de0-0d65a5641337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:57 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Volume volume-ea4b758d-fceb-4536-8010-4b4376e8f6ce (ea4b758d-fceb-4536-8010-4b4376e8f6ce): created successfully
Sep 10 14:14:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c89503-5799-4792-9de0-0d65a5641337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:57 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Flow 'volume_create_manager' (61035db2-71df-4547-89cc-8d3d3141e228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:57 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-9a03ddfb-f5f0-4ddd-8200-5d6c08ca5066 tempest-CinderUnicodeTest-1500868608 None] Created volume successfully.
Sep 10 14:14:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:57 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:57 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.157s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:14:57 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:14:57 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Deleted volume successfully.
Sep 10 14:14:57 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-e939b751-ce5e-418e-a148-05f415329b14 tempest-CreateVolumesFromSnapshotTest-266245230 None] Lock "cinder-55013a94-5728-42f1-b88d-19059c096437-delete_volume" released by "delete_volume" :: held 3.813s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:14:59 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.flows.manager.create_volume [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82823) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Flow 'volume_create_manager' (c9c20eff-190d-4fa7-9744-0e9c9bf9fd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36ec262-f7ba-472d-80ae-659859dcbea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36ec262-f7ba-472d-80ae-659859dcbea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1703023329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1be3f02-baec-4820-bf52-7cf48ec883ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16865881ab14ed2a7fea9221924adc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:59Z,use_quota=True,user_id='8020203a1ba1427f90c34c3701eff1bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d64cd8-53ae-49e4-98f9-4a3cb4f050a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d64cd8-53ae-49e4-98f9-4a3cb4f050a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b208579-bf00-4b1a-bdb2-786148a25a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b208579-bf00-4b1a-bdb2-786148a25a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1be3f02-baec-4820-bf52-7cf48ec883ad', 'volume_name': 'volume-d1be3f02-baec-4820-bf52-7cf48ec883ad', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dfb54b6-a3c2-48c1-8f63-d9dfb6420630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dfb54b6-a3c2-48c1-8f63-d9dfb6420630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30916724-d4b7-4ced-877b-e2cb0731fd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:14:59 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Volume d1be3f02-baec-4820-bf52-7cf48ec883ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1be3f02-baec-4820-bf52-7cf48ec883ad', 'volume_size': 1}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f95c1166c20>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T12:14:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1703023329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1be3f02-baec-4820-bf52-7cf48ec883ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16865881ab14ed2a7fea9221924adc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T12:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T12:14:59Z,use_quota=True,user_id='8020203a1ba1427f90c34c3701eff1bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fdb6c62-5605-4c77-814f-62b48ce73d3b),volume_type_id=6fdb6c62-5605-4c77-814f-62b48ce73d3b)}" {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Creating volume d1be3f02-baec-4820-bf52-7cf48ec883ad {{(pid=82823) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Selected 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7 as target Quobyte volume. {{(pid=82823) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 14:14:59 devstack cinder-volume[82823]: INFO cinder.volume.drivers.remotefs [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] casted to 10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7
Sep 10 14:14:59 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad 1073741824 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:14:59 devstack quobyte-client[82845]: System call of process 100077 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 14:14:59 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=171, name=volume-d1be3f02-baec-4820-bf52-7cf48ec883ad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:15:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad 1073741824" returned: 0 in 0.586s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad" returned: 0 in 0.227s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:00 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] <== create_volume: return (1024ms) {'provider_location': '10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'} {{(pid=82823) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 14:15:00 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:15:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30916724-d4b7-4ced-877b-e2cb0731fd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1be3f02-baec-4820-bf52-7cf48ec883ad', 'volume_size': 1}' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:15:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c990fe9b-2384-4e02-a757-fd9a5b414732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 14:15:00 devstack cinder-volume[82823]: INFO cinder.volume.flows.manager.create_volume [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Volume volume-d1be3f02-baec-4820-bf52-7cf48ec883ad (d1be3f02-baec-4820-bf52-7cf48ec883ad): created successfully
Sep 10 14:15:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c990fe9b-2384-4e02-a757-fd9a5b414732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82823) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 14:15:00 devstack cinder-volume[82823]: DEBUG cinder.volume.manager [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Flow 'volume_create_manager' (c9c20eff-190d-4fa7-9744-0e9c9bf9fd0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82823) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 14:15:00 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-348cae10-5526-4d9c-bd2c-a75d7ebd6979 tempest-CinderUnicodeTest-1500868608 None] Created volume successfully.
Sep 10 14:15:01 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:15:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:15:01 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:15:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] Creating offline snapshot 4072a4d2-fe7b-4957-a294-993769892369 of volume d1be3f02-baec-4820-bf52-7cf48ec883ad {{(pid=82823) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 14:15:02 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0e5820-2f8b-4f0c-97b2-f6ba93002968]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:15:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad" returned: 0 in 0.434s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369 1G {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:02 devstack quobyte-client[82845]: The server volume:fcc52668-bcd4-45ac-8e70-66f794d7241f@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fcc52668-bcd4-45ac-8e70-66f794d7241f, inode=172, name=volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.226), requestorAccessMask=0
Sep 10 14:15:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369 1G" returned: 0 in 0.264s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d1be3f02-baec-4820-bf52-7cf48ec883ad -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] CMD "qemu-img rebase -u -b volume-d1be3f02-baec-4820-bf52-7cf48ec883ad -F qcow2 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369" returned: 0 in 0.123s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:02 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369 is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:15:02 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369" returned: 0 in 0.091s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] Setting permissions: /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad -> 1000:1000 {{(pid=82823) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 14:15:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369" returned: 0 in 0.109s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.info" returned: 0 in 0.084s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:03 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] File path /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.info is being set with permissions: 660 {{(pid=82823) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 14:15:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.info {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.info" returned: 0 in 0.086s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:03 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.525s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:15:05 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-98fe9f54-ff7e-4a8f-b7df-3fc1f4f7fb8a tempest-CinderUnicodeTest-1500868608 None] Create snapshot completed successfully
Sep 10 14:15:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Acquiring lock "cinder-4072a4d2-fe7b-4957-a294-993769892369-delete_snapshot" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:15:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Lock "cinder-4072a4d2-fe7b-4957-a294-993769892369-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:15:06 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:15:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Acquiring lock "cinder-quobyte-d1be3f02-baec-4820-bf52-7cf48ec883ad" by "delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:15:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Lock "cinder-quobyte-d1be3f02-baec-4820-bf52-7cf48ec883ad" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:15:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Acquiring lock "cinder-quobyte-4072a4d2-fe7b-4957-a294-993769892369" by "_delete_snapshot" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:15:06 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Lock "cinder-quobyte-4072a4d2-fe7b-4957-a294-993769892369" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:15:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Deleting offline snapshot 4072a4d2-fe7b-4957-a294-993769892369 of volume d1be3f02-baec-4820-bf52-7cf48ec883ad {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 14:15:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] snapshot_file for this snap is: volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369 {{(pid=82823) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 14:15:06 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[00180462-9bd6-4800-8f50-83816e9fb19b]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:15:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369" returned: 0 in 0.400s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:06 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.remotefs [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1be3f02-baec-4820-bf52-7cf48ec883ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82823) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 14:15:06 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96a2e8d-709e-40b2-8ec5-3db93c07c58b]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:15:06 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad" returned: 0 in 0.417s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369" returned: 0 in 0.201s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369 {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:07 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad.4072a4d2-fe7b-4957-a294-993769892369" returned: 0 in 0.087s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Lock "cinder-quobyte-4072a4d2-fe7b-4957-a294-993769892369" released by "_delete_snapshot" :: held 1.388s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:15:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Lock "cinder-quobyte-d1be3f02-baec-4820-bf52-7cf48ec883ad" released by "delete_snapshot" :: held 1.413s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:15:07 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Created reservations ['9ef35377-5ee7-41b5-b019-c444f740a412', '14dd5a62-1711-48a3-9d0f-c249a66a256c', '9a57f176-bf08-4749-9124-b5e09fa03adf', '63bc8698-6795-4ffa-9db3-7ad0ebeee6b9'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:15:07 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Delete snapshot completed successfully.
Sep 10 14:15:07 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-a6bf51b8-4c48-43b2-b24d-e5ded3d71f6c tempest-CinderUnicodeTest-1500868608 None] Lock "cinder-4072a4d2-fe7b-4957-a294-993769892369-delete_snapshot" released by "delete_snapshot" :: held 1.877s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:15:08 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Acquiring lock "cinder-d1be3f02-baec-4820-bf52-7cf48ec883ad-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:15:08 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Lock "cinder-d1be3f02-baec-4820-bf52-7cf48ec883ad-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:15:08 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:15:08 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Acquiring lock "cinder-quobyte-d1be3f02-baec-4820-bf52-7cf48ec883ad" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:15:08 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Lock "cinder-quobyte-d1be3f02-baec-4820-bf52-7cf48ec883ad" acquired by "delete_volume" :: waited 0.015s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:15:08 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3186f30-86d1-43d4-8e15-785a7992bb6e]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:15:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad" returned: 0 in 0.390s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:08 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-d1be3f02-baec-4820-bf52-7cf48ec883ad" returned: 0 in 0.111s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:09 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Lock "cinder-quobyte-d1be3f02-baec-4820-bf52-7cf48ec883ad" released by "delete_volume" :: held 0.671s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:15:09 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Created reservations ['4ba9561e-143a-43a1-aac1-6ec0ea7cbeb8', '0803ca27-90de-46dc-9fea-b20f405021b4', '4b260f92-fb0c-4e9c-8a72-5412c8df64ab', '79e934c2-5d5c-453c-bd85-856f6bea2637'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:15:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:15:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:15:09 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:15:09 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:15:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:15:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:09 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.102s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:09 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:15:09 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Deleted volume successfully.
Sep 10 14:15:09 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-1b3a171a-eeae-4df1-8b4c-26c5388d6f7b tempest-CinderUnicodeTest-1500868608 None] Lock "cinder-d1be3f02-baec-4820-bf52-7cf48ec883ad-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:15:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Acquiring lock "cinder-ea4b758d-fceb-4536-8010-4b4376e8f6ce-delete_volume" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:15:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Lock "cinder-ea4b758d-fceb-4536-8010-4b4376e8f6ce-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:15:10 devstack cinder-volume[82823]: WARNING cinder.volume.volume_utils [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 14:15:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Acquiring lock "cinder-quobyte-ea4b758d-fceb-4536-8010-4b4376e8f6ce" by "delete_volume" {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 14:15:10 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Lock "cinder-quobyte-ea4b758d-fceb-4536-8010-4b4376e8f6ce" acquired by "delete_volume" :: waited 0.011s {{(pid=82823) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 14:15:10 devstack cinder-volume[82823]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5b533c-2199-4fc2-b3d1-8b4ae9df5447]: (4, 'qcow2') {{(pid=83122) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 14:15:10 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ea4b758d-fceb-4536-8010-4b4376e8f6ce {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ea4b758d-fceb-4536-8010-4b4376e8f6ce" returned: 0 in 0.406s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ea4b758d-fceb-4536-8010-4b4376e8f6ce {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] CMD "rm -f /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c/volume-ea4b758d-fceb-4536-8010-4b4376e8f6ce" returned: 0 in 0.097s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:11 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Lock "cinder-quobyte-ea4b758d-fceb-4536-8010-4b4376e8f6ce" released by "delete_volume" :: held 0.638s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:15:11 devstack cinder-volume[82823]: DEBUG cinder.quota [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Created reservations ['b6fa333b-29f7-4724-8107-8d6993986c5e', '305c7f0a-fdd0-4f64-afc2-7a17759c086f', 'b7c6d438-6eb1-4cb1-9fd6-74aeff89a06d', '7be27604-e3c3-4acf-a75b-57914e134ffe'] {{(pid=82823) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 14:15:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:15:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:15:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:15:11 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:15:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:15:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:11 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.086s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:11 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 14:15:12 devstack cinder-volume[82823]: INFO cinder.volume.manager [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Deleted volume successfully.
Sep 10 14:15:12 devstack cinder-volume[82823]: DEBUG cinder.coordination [None req-145a0cf0-744f-4da6-8b3d-220fc771e058 tempest-CinderUnicodeTest-1500868608 None] Lock "cinder-ea4b758d-fceb-4536-8010-4b4376e8f6ce-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=82823) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 14:15:21 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:UPDATE=125,cinder:DELETE=13,cinder:SELECT=75,cinder:INSERT=30 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:15:22 devstack cinder-volume[82823]: DEBUG dbcounter [-] [82823] Writing DB stats cinder:SELECT=82,cinder:UPDATE=118,cinder:DELETE=8,cinder:INSERT=35 {{(pid=82823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 14:15:30 devstack cinder-volume[82823]: DEBUG oslo_service.periodic_task [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82823) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 14:15:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 14:15:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 14:15:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7': None} {{(pid=82823) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 14:15:30 devstack cinder-volume[82823]: DEBUG cinder.volume.drivers.quobyte [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Available shares ['10.10.41.181/cinder-vol-61d8135a-74a6-4d92-b79b-2adec36762a7'] {{(pid=82823) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 14:15:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.lockutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=82823) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 14:15:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 14:15:30 devstack cinder-volume[82823]: DEBUG oslo_concurrency.processutils [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8d5b729c621b0ed139f5cfb2754d0f3c" returned: 0 in 0.184s {{(pid=82823) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 14:15:30 devstack cinder-volume[82823]: DEBUG cinder.manager [None req-6aaaa7ab-b9d2-4ea4-ae89-0f6cbb028c1d None None] Notifying Schedulers of capabilities ... {{(pid=82823) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}